Proposes: more MoEs at later layers + a shared expert.