Three Explorations on Pre-Training: an Analysis, an Approach, and an Architecture | Microsoft Research | Podwise