Large Scale Deployment of SMPTE 2110: the IP Live Production Facility
Total Page：16
File Type：pdf, Size：1020Kb
SMPTE Meeting Presentation Large Scale Deployment of SMPTE 2110: The IP Live Production Facility Steve Sneddon NBCUniversal, [email protected] Chris Swisher NBCUniversal, [email protected] Jeff Mayzurk NBCUniversal, [email protected] Written for presentation at the SMPTE 2019 Annual Technical Conference & Exhibition Abstract. In 2016, NBCUniversal began the project to design and build the new global headquarters for Telemundo Enterprises in Miami Florida. The facility that became known as Telemundo Center would feature 13 production studios and seven control rooms supporting scripted episodic content, daily live news and sports programming, beginning with FIFA World Cup 2018. To support the scale and flexibility required for a facility of this magnitude, the key technical design consideration was the use of a software-defined video network infrastructure. At the time of launch in spring of 2018, Telemundo Center was home to the largest SMPTE ST 2110 environment in the world, consisting of over 12,000 unique HD sources and 150,000 multicast streams across audio and video. This paper will explore the major considerations and challenges in building such a large scale, all-IP broadcast production facility. We will demonstrate design factors around switching of video flows, redundancy, control and orchestration, PTP master clock systems and handoffs to multi-manufacturer SMPTE ST 2110 devices as well as non-IP enabled devices. This paper will also discuss our experience and lessons learned with utilizing a Software Defined Network (SDN) control plane and routing commands that abstract the underlying physical and link-level connectivity. Some key topics include approaches to pooled resources and management of centralized operations; gaps in existing standards, with strategies to overcome limitations; the promise and the peril of differing ergonomic and performance characteristics of SMPTE ST 2110 endpoints – support for redundancy, clean switching, and audio/video synchronization We will propose a reference architecture for supporting a GPS-sourced, large-scale PTP distribution to over 500 end points and explore some of the limitations and corresponding solutions encountered in PTP distribution at scale. Finally, we will demonstrate new software-defined infrastructure concepts such as virtual sources and virtual destinations which replaced legacy physical design patterns in this build. Authorized licensed use limited to: SMPTE ALL INCLUSIVE. Downloaded on October 29,2020 at 16:35:55 UTC from IEEE Xplore. Restrictions apply. Contents Introduction ................................................................................................................................ 3 Facility Overview ........................................................................................................................ 4 Network Architecture and Core Technologies ............................................................................ 5 Leaf-spine and single tier architectures .................................................................................. 5 SDN and Hardware Controlled Network ................................................................................. 7 Video Network Redundancy ................................................................................................... 8 PTP and Reference Systems ................................................................................................10 SMPTE ST 2110 ...................................................................................................................13 Design Considerations and Implementation ..............................................................................14 Video Standard – HD, 3G, 4K ................................................................................................14 Network aggregation and Bandwidth Efficiency .....................................................................15 Audio Transport Considerations ............................................................................................16 Pooled Resource Management & Operational Presentation ..................................................17 IP to the Edge – How Far to Go? ...........................................................................................23 Conclusion ................................................................................................................................24 Missing Components – What do we need? ............................................................................24 Lessons Learned ...................................................................................................................27 Final Thoughts .......................................................................................................................31 SMPTE Meeting 2019 Large Scale Deployment of SMPTE 2110: The IP Live Production Facility 2 Authorized licensed use limited to: SMPTE ALL INCLUSIVE. Downloaded on October 29,2020 at 16:35:55 UTC from IEEE Xplore. Restrictions apply. Introduction In 2016, NBCUniversal broke ground on a project to design and build Telemundo Center, the new global headquarters for Telemundo Enterprises in Miami, Florida. This new facility would bring together a combination of offices and studios for Telemundo Network, Telemundo Studios, Telemundo International, and Universo Network, as well as being the home of NBCUniversal International's Latin America offices. Prior to the opening of Telemundo Center, the staff of Telemundo Enterprises had been located at many older facilities around the Miami metro area. Telemundo Center allowed for all groups within the Telemundo Enterprises umbrella to come together under one roof in a modern facility. Apart from bringing business units together, one of the many goals of the project was to make the facility as technically future-proof and flexible as possible to be able to best serve Telemundo’s needs in an evolving media landscape. “Telemundo Center is the manifestation of our commitment to the Hispanic market and a representation of our core values of innovation, collaboration and transparency,” said Cesar Conde, Chairman, NBCUniversal Telemundo Enterprises and NBCUniversal International Group. “Latinos are a growing cultural, political, and economic force influencing every aspect of our country. Telemundo Center is the only facility that can fuel the preferences and demands of this dynamic audience, while driving unlimited growth and opportunity for our company, our employees and our community for years to come.” (http://www.nbcuniversal.com/article/nbcuniversal-telemundo-enterprises-celebrates- new-global-headquarters) Telemundo Center opened its doors in mid-2018 with the premier event being the 31 days of coverage of the FIFA World Cup 2018. The facility is now a hub of content creation delivering daily live news, entertainment shows, sports programming, and scripted episodic content across multiple media platforms including broadcast, cable and digital. One of the major technologies we deployed to future-proof Telemundo center was video over IP using SMPTE ST 2110. At the time of launch, Telemundo Center was home to the largest ST 2110 environment in the world, consisting of over 12,000 unique HD sources and 150,000 multicast streams across audio and video. This paper will explore the major considerations and challenges in building such a large scale, all-IP broadcast production facility. We will demonstrate design factors around switching of video flows, redundancy, control and orchestration, PTP master clock systems and handoffs to multi-manufacturer SMPTE 2110 devices as well as non- IP enabled devices. This paper will also discuss our experience and lessons learned from designing, building and launching a large IP-only facility from the ground up. SMPTE Meeting 2019 Large Scale Deployment of SMPTE 2110: The IP Live Production Facility 3 Authorized licensed use limited to: SMPTE ALL INCLUSIVE. Downloaded on October 29,2020 at 16:35:55 UTC from IEEE Xplore. Restrictions apply. Facility Overview Telemundo Center is approximately a 500,000 square-foot facility located on 21 acres in Miami, Florida. In addition to office space with a capacity to house 1,500 employees, the building features full production facilities to enable news, sports and scripted Entertainment for broadcast and digital outlets. In support of those productions, the building features the following: • 13 production studios in various sizes up to 8000 SF • 5 live production control rooms • 72 edit seats – approximately half of which are desktop edit and half are edit rooms • 60 graphics creation seats • A central video playback area • A central graphics playback area • A central camera shading area • A transmission operations center A central equipment room supports the above operational areas. At the heart of the central equipment room (CER) is a redundant set of core IP video routers using the SMPTE ST 2110. The CER itself is designed as a collection of 12 pods of 14-28 racks each, total of 290 racks. The CER also houses the fiber core—over 10,000 strand presentations of mostly single-mode fiber for plant-wide cross patching. Fiber core frames feed out to intermediate distribution frame (IDF) rooms throughout the facility for secondary cross patching to local endpoints. To feed studios, fiber bundles of up to 144 strands terminate in studio support rooms serving the IDF and production demark function for each production studio.