Market-proven
since 1996
Technology focus
on
Multimedia Applications and services
Alex Shtein
Surf Proprietary Information
1
Topics for this presentation
» Indentify the main multi-media applications in the fixed-line and mobile
telecom market
» Provide a description of the main media-processing related challenges
for each of the above applications
Surf Proprietary Information
www.surf-com.com
2
Target Markets & applications
» Target markets and applications are divided into 4 Segments:

Segment 1: Telecom multi-media applications and services in IMS/NGN

Segment 2: IMS/NGN infrastructure

Segment 3: Enterprise Telephony

Segment 4: Over-the-top (OTT) rich content adaptation and streaming
Surf Proprietary Information
www.surf-com.com
3
Segment 1: Telecom Multi-media applications
» There are 4 main applications in the telecom space
» All 4 are relevant for fixed and mobile telephony

Interactive voice and video response (IVVR), implementing:
» Mobile banking, Video dating, Adult entertainment, etc.

Wide band telephony

Video/voice conferencing bridge

Video mail/messaging
Surf Proprietary Information
www.surf-com.com
4
Main challenges

IVVR
Various video content in different formats: requires transcoding
» from any to any codec
» Support for H.263, MPEG4
H.264 is becoming dominant
• Mobile»banking
» Handle resolutions of up to VGA/D1 in the input (720*576)
• video dating
Video
quality, interoperability and robustness
• Video
search
SurfExpress PCI/e
• Mobile»TVNeed to be able to optimize video quality especially at low bitrates
• Video »
blogSupport for in-band I-frame requests (relevant RFC’s)
» Interoperability with hundreds of mobile and fixed phones

Prompts in
various formats
Low latency from key stroke till change of appearance on the
Play prompt information
phone
3G-324M
or
» Running 3G-324M layer
and transcoding
layer on the same sub-system
RTP
» Fast switching of video contents without waiting
for I-frames
Server

Support fixed IP and mobile 3G-324M on the same platform
»

Storage
Receive DTMF
In ATCA, need to support iTDM for TDM transfer
Support for advanced video features:
» Scrolling text, multiple overlays at multiple languages
» Logos, bitmaps, lines insertions with transparency (Alpha blending)

3G-324M over an IP transport for easy interface with IP based
MSC
» Using transparent RTP
Surf Proprietary Information
» Using 3GPP IUuP/Nb-UP
www.surf-com.com
5
Wideband Telephony
RTP/AAC
RTP/G711.1
Main challenges
»
High density transcoding for wideband codecs

»
»
IP
For example, AAC-LC needs 10 time more resources then G.729
Wideband codec support

G.722.2 (WB-AMR), AAC-LC

G.711.1 will become important
WB-AMR
Wideband conferencing: optimize voice quality(G.722.2)

»
IP phone
Voice mixer needs to handle
wideband
• Conference
bridgeinputs at various sampling ratesy
• Announcement
server wideband devices and
Interoperability and interworking
between
narrow band devices
• Transcoder
Surf Proprietary Information
www.surf-com.com
6
Video Conferencing
Main challenges
»
»
Bridge between various types of endpoints (soft clients, desktop,
Mobile phones, MS Messenger, Skype..) with diverse codecs and
resolutions

Resolutions from SQCIF to VGA

Resizing from any device to any device
H.264/CIF
Support various transport layers (RTP, 3G-324M)

»
Video Phone
(Soft phone)
MPEG4/D1
3G phones and fixed (RTP) connected to the same bridge
Split screens, multiple layouts from the same conference
IP

Different
participants will view different layouts in same conference
SurfExpress
PCI/e

Layouts change based on dominant speaker change
»
Rich layout support:

»
H.264/VGA
Backgrounds and foregrounds
3G-324M/MPEG4/QCIF

Drawing lines

Text overlays for participant identification
Video Phone
(LCD, TV)
Large amount of participants per conference

Need to decode dozens of video sources  distributed conference
Video Phone
(Desktop phone)
Surf Proprietary Information
www.surf-com.com
7
Video Mail
SurfExpress PCI/e
Storage
Server
3G-324M/H.263 QCIF
Main challenges
Play message in a
different format
IP
»
Record in one format, play in another format (transcoding)
»
Resolution adjustment, transport adjustment
(3G-324MRTP)
RTP/H.263/CIF
RTP/H.264/VGA
Generate I-frames so that recorded message starts with an I-frame
»
»
Diverse resolutions and codecs (from VGA/D1 to QCIF phones)  high quality
rescaling
»
Audio-video synchronization
Video Phone
(Soft Client)
Surf Proprietary Information
Fixed Video
Phone
www.surf-com.com
8
Segment 2: IMS/NGN infrastructure
» There are 3 main IMS/NGN components that are involving multimedia processing

Media gateway (MGW)
» 3G to IP video gateway
» Voice gateway

Session Boarder Controller (SBC)

Media server – Media resource function (MRF/MRFP)
Surf Proprietary Information
www.surf-com.com
9
IMS Infrastructure: Media Gateway
Main challenges
»
Field hardened:

With top class echo canceller, T.38, interoperable

Voice quality at harsh network conditions
RTP/SIP
»
»
»
High
density
SIP IP phone
Media Gateway

Need iTDM for ATCA, uTCA

Low power and low
IP/NGN
footpring per port
PSTN
SurfRider/AMC
Rich codec support

Fixed and
mobile codecs
RTP/SIP

Narrowband and wideband codecs
3G-324m/H.263
H.264
Simultaneous voice and video support
SIP Video phone

Voice: TDMRTP

Video: 3G-324MRTP
Surf Proprietary Information
www.surf-com.com
10
IMS Infrastructure: SBC
Main challenges
»
SIP IP phone (not the TDMIP based
Packet to packet architecture
architecture of legacy telephony boards)
»
Voice/video transcoding




»
»
RTP framesize A  framesize B
G.711/RTP
SBC
IPv4  IPv6
IP Operator A
Wideband codec  narrowband codec
High density:

Number of concurrent sessions

Number of new calls per second (CPS)
IPv4
IP Operator B
SurfRider/AMC
Security:

»
Codec A 
G.729/SRTP
IPv6codec B
SRTP/AES
Use the same box for other IMS infrastructure (MRF, MGW)
Surf Proprietary Information
www.surf-com.com
11
IMS Infrastructure: MRF/MRFP
Storage
Servers
RTP/G.729
Prompts
in G.711
(example)
IP phone
RTP/G.729
Main challenges
IP/NGN
SurfExpress PCI/e
DTMF
»
High density and bottleneck-free architecture (move away from the TDM based
architecture of legacy boards)
»
»
»
High call-per-second
(CPS) score. At least 100 per board for a 10 second call duration.
Announcement
Servervoice/video, streaming, conferencing
Multiple services including
Support for distributed conferencing – at least 1000 voice participants on the same
bridge
Surf Proprietary Information
IP phone
www.surf-com.com
12
Segment 3: Enterprise telephony
» Next generation IP-PBX




First generation PBX supported PSTN
Second generation PBX integrated an external VoIP gateway to the
PBX
Third generation PBX was an integration of the VoIP and PSTN in one
box (IP-PBX)
Forth generation PBX is an integration of all multi-media services into
the IP-PBX, including
» Video IVVR
» Video conferencing
» Video mail
Surf Proprietary Information
www.surf-com.com
13
Multi-Media IP-PBX
Main challenges
»
Low cost per port / high functionality
»
Integration of VoIP services:
Surf DSP chip
»

VoIP gateway,

Fax server, Internet aware fax

IP Phone bridge,
Conferencing

Analog modem backup connection,

Voice mail
PSTN Phone
IP
Integration of Multi-media services:

Video mail

Video conferencing bridge

Video IVR (IVVR)
Printer
Modem
PSTN
PBX
• VoIP GW
• Conference bridge
• Fax server
Fax
• Modem backup connection
• Codec transcoder
Surf Proprietary Information
www.surf-com.com
14
Segment 4: Over The Top (OTT) rich content
adaptation and streaming
» Focused around rich content (video) IP streaming to mobile
phones and PCs connected to mobile internet
» Various applications, including:

LiveTV to mobile

Mobile Video on demand (VoD)

Streaming of web content to the mobile (web-to-mobile)

Streaming of web content to mobile internet (web-to-web)

Video Advertisements injection
Surf Proprietary Information
www.surf-com.com
15
Mobile TV & Other Streaming Video Services
Main challenges
»
Optimize Video quality, and quality of experience (QoE):

»
»
Video streaming with on-the-fly bitrate adaptation  adapt to each
device’s variable network connection quality
HTTP
Ad Server
Transcoding/repurposing content from web to mobile:

SurfExpress
PCI/e
Flash(FLV), H.264 &
older codecs
(VP6, Sorenson)

RTSP streaming and progressing download
RTP
Enable service personalization:

Advertisement injectionRTP/UDP/IP

Logo, scrolling text, transparency (Alpha blending)
Live feed
(unicast)
»
Support high resolutions in the Input

»
»
flv
Streaming
Server
Web
For example YouTube stores content at high quality (VGA, D1)
RTCP
Support high resolutions in the Output
3GPP

Relevant when streaming to laptops connected to mobile Internet.

Requires support for resolutions up to VGA in the output
Storage
Servers
Cable to mobile:

Support for Mpeg2 Transport stream (MP2TS)

Support for AAC codec
Surf Proprietary Information
www.surf-com.com
16
Thank You
Surf Proprietary Information
www.surf-com.com
17
Descargar

Multimedia Applications & Services