How Netflix Builds High Performance Applications at Global Scale

•Download as PPTX, PDF•

0 likes•162 views

We all want to build applications that are blazingly fast. We also want to scale them to users all over the world. Can the two happen together? Can users in the slowest of environments also get a fast experience? Learn how we do this at Netflix: how we understand every user's needs and preferences and build high performance applications that work for every user, every time.

HOSTED BY
How Netflix Builds High Performance
Applications at Global Scale
Prasanna Vijayanathan
Senior Software Engineer at Netflix

Prasanna Vijayanathan (he/him)
Senior Software Engineer at Netflix
■ Something cool I’ve done
■ My perspective on P99s
■ Another thing about me
■ What I do away from work

Your app
(phone, browser,
TV, multiverse?)

Your infrastructure
Your app
(phone,
browser, TV,
multiverse?)
Reverse
proxy/load
balancer
Data
Microservices

Your infrastructure
Your app
(phone,
browser, TV,
multiverse?)
Reverse
proxy/load
balancer
Data
Microservices
CDNs

Your infrastructure
Your app
(phone,
browser, TV,
multiverse?)
Reverse
proxy/load
balancer
Data
Microservices
CDNs
Users

Understanding your application
Observability and monitoring

Your infrastructure
Your app
(phone,
browser, TV,
multiverse?)
Reverse
proxy/load
balancer
Data
Microservices
CDNs
Users
Errors, latency

Your infrastructure
Your app
(phone,
browser, TV,
multiverse?)
Reverse
proxy/load
balancer
Data
Microservices
CDNs
Users
Errors, latency
Tracking

How Netflix Builds High Performance Applications at Global Scale

Your app
(phone, browser, TV,
multiverse?)
Users
Engagement
- Sessions
- Time spent on app
Environment
- Platform
- Device capabilities
- Network conditions
Experience
- Time to load the app
- Time to render
- Video quality

Diversity at scale
Platform
Memory
Computing & efficiency
Device
Location
Network
Geo
Needs
Preferences
Users

Diversity in devices
• Web
• Mobile
• TV
• Other devices (VR, Watches, Glasses,..)
Platform
• Crashes and errors
• Storage
• Buffering
Memory
• CPU/GPU
• Energy consumption
Computing and efficiency

Diversity in network
• Ethernet, Fiber, WiFi, 4G, 5G
Type of Network
• 1000s of providers
• different plans
ISPs
• bandwidth, throughput, errors
Factors impacting networks

Diversity in Users
• What does the user need from the app?
User's needs
• How does the user expect the app to behave?
User's preferences

Consistency of QoE
Experience is relative
Users like to get expected behavior

Consistency of QoE
Provide the expected behavior every time
Do better whenever possible

Consistency of QoE
How to know what’s expected?
User disruptions

User
Disruptions
Needs &
Preferences
Environment

Needs & Preferences
App improvements
New product offerings, features, performance
Better feedback
Lower support calls
Longer sessions, more engagement
User
Needs &
Preferences
Distruptions Environment

Disruptions
Errors, crashes
Action fails
Loading spinners
User
Disruptions
Needs &
Preferences
Environment

Environment
User
Environment
Needs &
Preferences
Device
Make/model, platform, memory, CPU
Network
throughput, latency, errors
Others
time, location, seasonality
Disruptions

How could we do this?
QOE models
■ Devices
■ Networks
■ Disruption prediction
Transfer learning
■ Learn what’s good and bad for each user

How could we do this?
<Demo: building a model with a sample data set>

How could we do this?
<Demo: Show using SHAP values for interpretability>

What’s possible?
■ Constant iteration and improvement
■ Automatic feature selection and experimentation
■ The best experience possible, every user, every time.

First Last
email@address.com
@twitter
website/blog url
Thank you! Let’s connect.

Similar to How Netflix Builds High Performance Applications at Global Scale

Gomez

barkstriker

Gomez helps organizations deliver quality experiences to web and mobile users through optimal performance and availability monitoring across all users, browsers, devices, and geographies. They provide insight into how performance issues affect business metrics like revenue, brand, and costs. With over 3,000 customers worldwide including 1,500 enterprise customers, Gomez is an industry leader according to analysts and helps customers achieve measurable benefits like increased conversions and reduced costs.

Virtualization for users

Vijender Yadav

HPE | Network Virtualization | POC

Jeffrey Nunn

The document discusses how to conduct a proof of concept (POC) using HP Network Virtualization tools. It describes scoping the POC by discussing the application, objectives, prerequisites and selecting network test scenarios. The goals are to demonstrate the value of the tools, ensure a successful POC by keeping the scope well-defined, and progress the sales process by showing results meet success criteria. Network impairments like latency, jitter and bandwidth constraints can impact the user experience and should be considered in test scenarios.

Native app or PWA which is the better choice

JessieBrewer3

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...

Bitbar

AppNeura

PerformanceEngineeri

2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned

Eneko Jon Bilbao

Magical Performance tuning with Gomez

mcsaha

1) Traditional load testing is limited in its ability to accurately measure end-user experience and identify issues with third-party components. 2) Load testing 2.0 uses real user testing from geographically distributed locations to more realistically drive large volumes of load and uncover regional response time discrepancies and external errors. 3) An online retailer used load testing 2.0 to identify that a third-party component was insufficient under load, affecting the performance of their overall application.

Are You Ready For More Visitors Cognizant Gomez Jan20

Compuware APM

1) Traditional load testing is limited in its ability to accurately measure end-user experience and identify issues with third-party components. 2) Load testing 2.0 uses real user testing from geographically distributed locations to better understand regional response times and external factors that impact performance. 3) A case study showed that load testing 2.0 uncovered poor response times for key revenue regions that traditional load testing failed to detect.

Testing Strategy for Progressive Web Apps

Perfecto by Perforce

As the digital space continues to evolve, Progressive Web Apps (PWA) are gaining momentum. PWAs aim to improve user experience and are about to become a game changer – will you be ready? Join us for this live webinar & learn: * What Progressive Web Apps are and why they're gaining momentum * Key differences between Progressive Web Apps, responsive web design, hybrid and native apps * Best practices and tools for testing Progressive Web Apps And see a live demo of a Progressive Web App in action

Experitest & Hexaware Co-Webinar

Experitest

Experitest & Hexaware on a joint webinar on performance testing for mobile which highlights the need for a Performance Testing Strategy. The session will show you how to get the most from your testing budget by using mobile testing tools that integrate functionality, performance, load, network virtualization and more in securing the quality of your mobile application. The session will discuss: - Today's approach towards performance testing of mobile apps - Using cutting edge tools, solutions, and methodologies as part of your testing strategy - A case study highlighting Hexaware’s experience in performance testing of a financial Mobile App - Demonstration of Experitest’s SeeTest Network Virtualization solution Speakers: Guy Arieli, CTO, Experitest Vinayak Gaur , Head of mobile testing practice, Hexaware Technologies

Mobile performance testing

hunz

This document discusses performance testing for mobile applications. It outlines the importance of performance testing given the growth of mobile platforms and users' tendency to abandon apps with performance issues. It then describes various types of mobile apps and some common performance challenges. The rest of the document provides techniques for testing aspects like network performance, battery usage, and memory consumption on different mobile devices and networks. It also lists some tools that can be used for performance testing of mobile apps.

Testing Services - Software Quality Assurance

CCS Technologies (P) Ltd.

CCS Technologies offers a comprehensive suite of Quality Assurance & software testing services spanning consulting, enterprise services, independent validation services and end-to-end application testing solutions. We use an established testing methodology and employ a wide range of industry-standard testing tools that leverage established methodologies to ensure superior software quality at optimal cost and ensure delivery at the right time, every time. Read More: https://ccs-technologies.com/quality-assurance/

Why Progressive Web Apps For WordPress - WordCamp Finland

Imran Sayed

Progressive web apps (PWAs) combine the best of the web and the best of mobile apps. PWAs use newer web capabilities like service workers and app manifests to deliver app-style experiences to users. There are six main steps to building a PWA: 1) creating a web app manifest, 2) registering a service worker, 3) adding files to cache, 4) deleting previous caches, 5) fetching data from the cache, and 6) adding a custom "Add to Home Screen" option. PWAs offer benefits like being installable, working offline, being discoverable, and loading instantly like regular web pages. WordPress plugins exist to help websites build PWAs and add features like

Mobile Performance Testing Approaches and Challenges

Nous Infosystems

SolarWinds Product Management Technical Drilldown on Deep Packet Inspection a...

SolarWinds

Optimizing Global Application Delivery Webinar

Ginny Au

This webinar presented by Coevolve discusses optimizing global application delivery. It introduces Coevolve and their approach, which leverages DNS redirection and Aryaka's private core network to provide an optimized path for enterprise applications. This improves performance by redirecting traffic onto a private overlay network with points of presence around the world and TCP optimization. The presentation discusses challenges with delivering applications over the public internet, demonstrates how their solution works, and provides examples of use cases it can address like virtual desktops and SSL VPNs. It encourages attendees to test the solution for themselves.

IT Operations Management with OpManager

ManageEngine, Zoho Corporation

Choosing the right mobile architecture

Lonneke Dikmans

Innovate 2013 session 1243 mobile testing.v3

Leigh Williamson

This document provides a summary of a presentation on addressing challenges in mobile application testing. It discusses how mobile application testing is different than traditional web testing due to factors like device fragmentation, new capabilities to test, and more network considerations. It also outlines what mobile testers need, including test automation, device cloud access, test planning and reporting tools, and the ability to test various parts of a mobile solution like the backend systems and network. The presentation was given by representatives from IBM and AT&T.

Similar to How Netflix Builds High Performance Applications at Global Scale (20)

Gomez

Virtualization for users

HPE | Network Virtualization | POC

Native app or PWA which is the better choice

The Best of Both Worlds - Combining Performance and Functional Mobile App Tes...

AppNeura

2015 Mastering SAP Tech - Enterprise Mobility - Testing Lessons Learned

Magical Performance tuning with Gomez

Are You Ready For More Visitors Cognizant Gomez Jan20

Testing Strategy for Progressive Web Apps

Experitest & Hexaware Co-Webinar

Mobile performance testing

Testing Services - Software Quality Assurance

Why Progressive Web Apps For WordPress - WordCamp Finland

Mobile Performance Testing Approaches and Challenges

SolarWinds Product Management Technical Drilldown on Deep Packet Inspection a...

Optimizing Global Application Delivery Webinar

IT Operations Management with OpManager

Choosing the right mobile architecture

Innovate 2013 session 1243 mobile testing.v3

More from ScyllaDB

Using ScyllaDB for Real-Time Write-Heavy Workloads

ScyllaDB

Keeping latencies low for highly concurrent, intensive data ingestion ScyllaDB’s “sweet spot” is workloads over 50K operations per second that require predictably low (e.g., single-digit millisecond) latency. And its unique architecture makes it particularly valuable for the real-time write-heavy workloads such as those commonly found in IoT, logging systems, real-time analytics, and order processing. Join ScyllaDB technical director Felipe Cardeneti Mendes and principal field engineer, Lubos Kosco to learn about: - Common challenges that arise with real-time write-heavy workloads - The tradeoffs teams face and tips for negotiating them - ScyllaDB architectural elements that support real-time write-heavy workloads - How your peers are using ScyllaDB with similar workloads

Unconventional Methods to Identify Bottlenecks in Low-Latency and High-Throug...

ScyllaDB

In this presentation, we explore how standard profiling and monitoring methods may fall short in identifying bottlenecks in low-latency data ingestion workflows. Instead, we showcase the power of simple yet clever methods that can uncover hidden performance limitations. Attendees will discover unconventional techniques, including clever logging, targeted instrumentation, and specialized metrics, to pinpoint bottlenecks accurately. Real-world use cases will be presented to demonstrate the effectiveness of these methods. By the end of the session, attendees will be equipped with alternative approaches to identify bottlenecks and optimize their low-latency data ingestion workflows for high throughput.

Mitigating the Impact of State Management in Cloud Stream Processing Systems

ScyllaDB

Stream processing is a crucial component of modern data infrastructure, but constructing an efficient and scalable stream processing system can be challenging. Decoupling compute and storage architecture has emerged as an effective solution to these challenges, but it can introduce high latency issues, especially when dealing with complex continuous queries that necessitate managing extra-large internal states. In this talk, we focus on addressing the high latency issues associated with S3 storage in stream processing systems that employ a decoupled compute and storage architecture. We delve into the root causes of latency in this context and explore various techniques to minimize the impact of S3 latency on stream processing performance. Our proposed approach is to implement a tiered storage mechanism that leverages a blend of high-performance and low-cost storage tiers to reduce data movement between the compute and storage layers while maintaining efficient processing. Throughout the talk, we will present experimental results that demonstrate the effectiveness of our approach in mitigating the impact of S3 latency on stream processing. By the end of the talk, attendees will have gained insights into how to optimize their stream processing systems for reduced latency and improved cost-efficiency.

Measuring the Impact of Network Latency at Twitter

ScyllaDB

Architecting a High-Performance (Open Source) Distributed Message Queuing Sys...

ScyllaDB

BlazingMQ is a new open source* distributed message queuing system developed at and published by Bloomberg. It provides highly-performant queues to applications for asynchronous, efficient, and reliable communication. This system has been used at scale at Bloomberg for eight years, where it moves terabytes of data and billions of messages across tens of thousands of queues in production every day. BlazingMQ provides highly-available, fault-tolerant queues courtesy of replication based on the Raft consensus algorithm. In addition, it provides a rich set of enterprise message routing strategies, enabling users to implement a variety of scenarios for message processing. Written in C++ from the ground up, BlazingMQ has been architected with low latency as one of its core requirements. This has resulted in some unique design and implementation choices at all levels of the system, such as its lock-free threading model, custom memory allocators, compact wire protocol, multi-hop network topology, and more. This talk will provide an overview of BlazingMQ. We will then delve into the system’s core design principles, architecture, and implementation details in order to explore the crucial role they play in its performance and reliability. *BlazingMQ will be released as open source between now and P99 (exact timing is still TBD)

Noise Canceling RUM by Tim Vereecke, Akamai

ScyllaDB

Noisy Real User Monitoring (RUM) data can ruin your P99! We introduce a fresh concept called ""Human Visible Navigations"" (HVN) to tackle this risk; we focus on the experiences you actually care about when talking about the speed of our sites: - Human: We exclude noise coming from bots and synthetic measurements. - Visible: We remove any partial or fully hidden experiences. These tend to be very slow but users don’t see this slowness. - Navigations: We ignore lightning fast back-forward navigations which usually have few optimisation opportunities. Adopting Human Visible Navigations provides you with these key benefits: - Fewer changes staying below the radar - Fewer data fluctuations - Fewer blindspots when finding bottlenecks - Better correlation with business metrics This is supported by plenty of real world examples coming from the world's largest scale modeling site (6M Monthly visits) in combination with aggregated data from the brand new rumarchive.com (open source) After attending this session; your P99 and other percentiles will become less noisy and easier to tune!

Running a Go App in Kubernetes: CPU Impacts

ScyllaDB

Always-on Profiling of All Linux Threads, On-CPU and Off-CPU, with eBPF & Con...

ScyllaDB

In this session, Tanel introduces a new open source eBPF tool for efficiently sampling both on-CPU events and off-CPU events for every thread (task) in the OS. Linux standard performance tools (like perf) allow you to easily profile on-CPU threads doing work, but if we want to include the off-CPU timing and reasons for the full picture, things get complicated. Combining eBPF task state arrays with periodic sampling for profiling allows us to get both a system-level overview of where threads spend their time, even when blocked and sleeping, and allow us to drill down into individual thread level, to understand why.

Performance Budgets for the Real World by Tammy Everts

ScyllaDB

Performance budgets have been around for more than ten years. Over those years, we’ve learned a lot about what works, what doesn’t, and what we need to improve. In this session, Tammy revisits old assumptions about performance budgets and offers some new best practices. Topics include: • Understanding performance budgets vs. performance goals • Aligning budgets with user experience • Pros and cons of Core Web Vitals • How to stay on top of your budgets to fight regressions

Using Libtracecmd to Analyze Your Latency and Performance Troubles

ScyllaDB

Trying to figure out why your application is responding late can be difficult, especially if it is because of interference from the operating system. This talk will briefly go over how to write a C program that can analyze what in the Linux system is interfering with your application. It will use trace-cmd to enable kernel trace events as well as tracing lock functions, and it will then go over a quick tutorial on how to use libtracecmd to read the created trace.dat file to uncover what is the cause of interference to you application.

Reducing P99 Latencies with Generational ZGC

ScyllaDB

With the low-latency garbage collector ZGC, GC pause times are no longer a big problem in Java. With sub-millisecond pause times there are instead other things in the GC and JVM that can cause application threads to experience unexpected latencies. This talk will dig into a specific use where the GC pauses are no longer the cause of unexpected latencies and look at how adding generations to ZGC help lower the p99 application latencies.

5 Hours to 7.7 Seconds: How Database Tricks Sped up Rust Linting Over 2000X

ScyllaDB

Linters are a type of database! They are a collection of lint rules — queries that look for rule violations to report — plus a way to execute those queries over a source code dataset. This is a case study about using database ideas to build a linter that looks for breaking changes in Rust library APIs. Maintainability and performance are key: new Rust releases tend to have mutually-incompatible ways of representing API information, and we cannot afford to reimplement and optimize dozens of rules for each Rust version separately. Fortunately, databases don't require rewriting queries when the underlying storage format or query plan changes! This allows us to ship massive optimizations and support multiple Rust versions without making any changes to the queries that describe lint rules. Ship now, optimize later"" can be a sustainable development practice after all — join us to see how!

Conquering Load Balancing: Experiences from ScyllaDB Drivers

ScyllaDB

Load balancing seems simple on the surface, with algorithms like round-robin, but the real world loves throwing curveballs. Join me in this session as we delve into the intricacies of load balancing within ScyllaDB Drivers. Discover firsthand experiences from our journey in driver development, where we employed the Power of Two Choices algorithm, optimized the implementation of load balancing in Rust Driver, mitigated cloud costs through zone-aware load balancing and combated the issue of overloading a particular core of ScyllaDB. Be prepared to delve into the practical and theoretical aspects of load balancing, gaining valuable insights along the way.

Interaction Latency: Square's User-Centric Mobile Performance Metric

ScyllaDB

Mobile performance metrics often take inspiration from the backend world and measure resource usage (CPU usage, memory usage, etc) and workload durations (how long a piece of code takes to run). However, mobile apps are used by humans and the app performance directly impacts their experience, so we should primarily track user-centric mobile performance metrics. Following the lead of tech giants, the mobile industry at large is now adopting the tracking of app launch time and smoothness (jank during motion). At Square, our customers spend most of their time in the app long after it's launched, and they don't scroll much, so app launch time and smoothness aren't critical metrics. What should we track instead? This talk will introduce you to Interaction Latency, a user-centric mobile performance metric inspired from the Web Vital metric Interaction to Next Paint"" (web.dev/inp). We'll go over why apps need to track this, how to properly implement its tracking (it's tricky!), how to aggregate this metric and what thresholds you should target.

How to Avoid Learning the Linux-Kernel Memory Model

ScyllaDB

The Linux-kernel memory model (LKMM) is a powerful tool for developing highly concurrent Linux-kernel code, but it also has a steep learning curve. Wouldn't it be great to get most of LKMM's benefits without the learning curve? This talk will describe how to do exactly that by using the standard Linux-kernel APIs (locking, reference counting, RCU) along with a simple rules of thumb, thus gaining most of LKMM's power with less learning. And the full LKMM is always there when you need it!

99.99% of Your Traces are Trash by Paige Cruz

ScyllaDB

Distributed tracing is still finding its footing in many organizations today, one challenge to overcome is the data volume - keeping 100% of your traces is expensive and unnecessary. Enter sampling - head vs tail how do you decide? Let’s look at the design of Sifter and get familiar with why tail-based sampling is the way to enact a cost-effective tracing solution while actually increasing the system’s observability.

Square's Lessons Learned from Implementing a Key-Value Store with Raft

ScyllaDB

To put it simply, Raft is used to make a use case (e.g., key-value store, indexing system) more fault tolerant to increase availability using replication (despite server and network failures). Raft has been gaining ground due to its simplicity without sacrificing consistency and performance. Although we'll cover Raft's building blocks, this is not about the Raft algorithm; it is more about the micro-lessons one can learn from building fault-tolerant, strongly consistent distributed systems using Raft. Things like majority agreement rule (quorum), write-ahead log, split votes & randomness to reduce contention, heartbeats, split-brain syndrome, snapshots & logs replay, client requests dedupe & idempotency, consistency guarantees (linearizability), leases & stale reads, batching & streaming, parallelizing persisting & broadcasting, version control, and more! And believe it or not, you might be using some of these techniques without even realizing it! This is inspired by Raft paper (raft.github.io), publications & courses on Raft, and an attempt to implement a key-value store using Raft as a side project.

Making Python 100x Faster with Less Than 100 Lines of Rust

ScyllaDB

A Deep Dive Into Concurrent React by Matheus Albuquerque

ScyllaDB

The Latency Stack: Discovering Surprising Sources of Latency

ScyllaDB

Usually, when an API call is slow, developers blame ourselves and our code. We held a lock too long, or used a blocking operation, or built an inefficient query. But often, the simple picture of latency as “the time a server takes to process a message” hides a great deal of end-to-end complexity. Debugging tail latencies requires unpacking the abstractions that we normally ignore: virtualization, hidden queues, and network behavior. In this talk, I’ll describe how developers can diagnose more sources of delay and failure by building a more realistic and broad understanding of networked services. I’ll give some real-world cases when high end-to-end latency or elevated failure rates occurred due to factors we ordinarily might not even measure. Some examples include TCP SYN retransmission; virtualization on the client; and surprising behavior from AWS load balancers. Unfortunately, many measurement techniques don’t cover anything but the portion most directly under developer control. But developers can do better by comparing multiple measurements, applying Little’s law, investing in eBPF probes, and paying attention to the network layer. Understanding API performance to find and fix issues faster ultimately means understanding the entire stack: the client, your code, and the underlying infrastructure.

More from ScyllaDB (20)

Using ScyllaDB for Real-Time Write-Heavy Workloads

Unconventional Methods to Identify Bottlenecks in Low-Latency and High-Throug...

Mitigating the Impact of State Management in Cloud Stream Processing Systems

Measuring the Impact of Network Latency at Twitter

Architecting a High-Performance (Open Source) Distributed Message Queuing Sys...

Noise Canceling RUM by Tim Vereecke, Akamai

Running a Go App in Kubernetes: CPU Impacts

Always-on Profiling of All Linux Threads, On-CPU and Off-CPU, with eBPF & Con...

Performance Budgets for the Real World by Tammy Everts

Using Libtracecmd to Analyze Your Latency and Performance Troubles

Reducing P99 Latencies with Generational ZGC

5 Hours to 7.7 Seconds: How Database Tricks Sped up Rust Linting Over 2000X

Conquering Load Balancing: Experiences from ScyllaDB Drivers

Interaction Latency: Square's User-Centric Mobile Performance Metric

How to Avoid Learning the Linux-Kernel Memory Model

99.99% of Your Traces are Trash by Paige Cruz

Square's Lessons Learned from Implementing a Key-Value Store with Raft

Making Python 100x Faster with Less Than 100 Lines of Rust

A Deep Dive Into Concurrent React by Matheus Albuquerque

The Latency Stack: Discovering Surprising Sources of Latency

Recently uploaded

DefCamp_2016_Chemerkin_Yury_--_publish.pdf

Yury Chemerkin

Mule Experience Hub and Release Channel with Java 17

Bhajan Mehta

FIDO Munich Seminar Introduction to FIDO.pptx

FIDO Alliance

Demystifying Neural Networks And Building Cybersecurity Applications

Priyanka Aash

In today's rapidly evolving technological landscape, Artificial Neural Networks (ANNs) have emerged as a cornerstone of artificial intelligence, revolutionizing various fields including cybersecurity. Inspired by the intricacies of the human brain, ANNs have a rich history and a complex structure that enables them to learn and make decisions. This blog aims to unravel the mysteries of neural networks, explore their mathematical foundations, and demonstrate their practical applications, particularly in building robust malware detection systems using Convolutional Neural Networks (CNNs).

Zaitechno Handheld Raman Spectrometer.pdf

AmandaCheung15

The Zaitechno Handheld Raman Spectrometer is a powerful and portable tool for rapid, non-destructive chemical analysis. It utilizes Raman spectroscopy, a technique that analyzes the vibrational fingerprint of molecules to identify their chemical composition. This handheld instrument allows for on-site analysis of materials, making it ideal for a variety of applications, including: Material identification: Identify unknown materials, minerals, and contaminants. Quality control: Ensure the quality and consistency of raw materials and finished products. Pharmaceutical analysis: Verify the identity and purity of pharmaceutical compounds. Food safety testing: Detect contaminants and adulterants in food products. Field analysis: Analyze materials in the field, such as during environmental monitoring or forensic investigations. The Zaitechno Handheld Raman Spectrometer is easy to use and features a user-friendly interface. It is compact and lightweight, making it ideal for field applications. With its rapid analysis capabilities, the Zaitechno Handheld Raman Spectrometer can help you improve efficiency and productivity in your research or quality control workflows.

NVIDIA at Breakthrough Discuss for Space Exploration

Alison B. Lowndes

Top 12 AI Technology Trends For 2024.pdf

Marrie Morris

What's New in Teams Calling, Meetings, Devices June 2024

Stephanie Beckett

Keynote : Presentation on SASE Technology

Priyanka Aash

Secure Access Service Edge (SASE) solutions are revolutionizing enterprise networks by integrating SD-WAN with comprehensive security services. Traditionally, enterprises managed multiple point solutions for network and security needs, leading to complexity and resource-intensive operations. SASE, as defined by Gartner, consolidates these functions into a unified cloud-based service, offering SD-WAN capabilities alongside advanced security features like secure web gateways, CASB, and remote browser isolation. This convergence not only simplifies management but also enhances security posture and application performance across global networks and cloud environments. Discover how adopting SASE can streamline operations and fortify your enterprise's digital transformation strategy.

How UiPath Discovery Suite supports identification of Agentic Process Automat...

DianaGray10

📚 Understand the basics of the newly persona-based LLM-powered Agentic Process Automation and discover how existing UiPath Discovery Suite products like Communication Mining, Process Mining, and Task Mining can be leveraged to identify APA candidates. Topics Covered: 💡 Idea Behind APA: Explore the innovative concept of Agentic Process Automation and its significance in modern workflows. 🔄 How APA is Different from RPA: Learn the key differences between Agentic Process Automation and Robotic Process Automation. 🚀 Discover the Advantages of APA: Uncover the unique benefits of implementing APA in your organization. 🔍 Identifying APA Candidates with UiPath Discovery Products: See how UiPath's Communication Mining, Process Mining, and Task Mining tools can help pinpoint potential APA candidates. 🔮 Discussion on Expected Future Impacts: Engage in a discussion on the potential future impacts of APA on various industries and business processes. Enhance your knowledge on the forefront of automation technology and stay ahead with Agentic Process Automation. 🧠💼✨ Speakers: Arun Kumar Asokan, Delivery Director (US) @ qBotica and UiPath MVP Naveen Chatlapalli, Solution Architect @ Ashling Partners and UiPath MVP

Enterprise_Mobile_Security_Forum_2013.pdf

Yury Chemerkin

Mastering Board Best Practices: Essential Skills for Effective Non-profit Lea...

OnBoard

Keynote : AI & Future Of Offensive Security

Priyanka Aash

In the presentation, the focus is on the transformative impact of artificial intelligence (AI) in cybersecurity, particularly in the context of malware generation and adversarial attacks. AI promises to revolutionize the field by enabling scalable solutions to historically challenging problems such as continuous threat simulation, autonomous attack path generation, and the creation of sophisticated attack payloads. The discussions underscore how AI-powered tools like AI-based penetration testing can outpace traditional methods, enhancing security posture by efficiently identifying and mitigating vulnerabilities across complex attack surfaces. The use of AI in red teaming further amplifies these capabilities, allowing organizations to validate security controls effectively against diverse adversarial scenarios. These advancements not only streamline testing processes but also bolster defense strategies, ensuring readiness against evolving cyber threats.

TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification

TrustArc

In a landmark year marked by significant AI advancements, it’s vital to prioritize transparency, accountability, and respect for privacy rights with your AI innovation. Learn how to navigate the shifting AI landscape with our innovative solution TRUSTe Responsible AI Certification, the first AI certification designed for data protection and privacy. Crafted by a team with 10,000+ privacy certifications issued, this framework integrated industry standards and laws for responsible AI governance. This webinar will review: - How compliance can play a role in the development and deployment of AI systems - How to model trust and transparency across products and services - How to save time and work smarter in understanding regulatory obligations, including AI - How to operationalize and deploy AI governance best practices in your organization

It's your unstructured data: How to get your GenAI app to production (and spe...

Zilliz

So you've successfully built a GenAI app POC for your company -- now comes the hard part: bringing it to production. Aparavi addresses the challenges of AI projects while addressing data privacy and PII. Our Service for RAG helps AI developers and data scientists to scale their app to 1000s to millions of users using corporate unstructured data. Aparavi’s AI Data Loader cleans, prepares and then loads only the relevant unstructured data for each AI project/app, enabling you to operationalize the creation of GenAI apps easily and accurately while giving you the time to focus on what you really want to do - building a great AI application with useful and relevant context. All within your environment and never having to share private corporate data with anyone - not even Aparavi.

Self-Healing Test Automation Framework - Healenium

Knoldus Inc.

Generative AI technology is a fascinating field that focuses on creating comp...

Nohoax Kanont

Generative AI technology is a fascinating field that focuses on creating computer models capable of generating new, original content. It leverages the power of large language models, neural networks, and machine learning to produce content that can mimic human creativity. This technology has seen a surge in innovation and adoption since the introduction of ChatGPT in 2022, leading to significant productivity benefits across various industries. With its ability to generate text, images, video, and audio, generative AI is transforming how we interact with technology and the types of tasks that can be automated.

What's New in Copilot for Microsoft 365 June 2024.pptx

Stephanie Beckett

Retrieval Augmented Generation Evaluation with Ragas

Zilliz

Retrieval Augmented Generation (RAG) enhances chatbots by incorporating custom data in the prompt. Using large language models (LLMs) as judge has gained prominence in modern RAG systems. This talk will demo Ragas, an open-source automation tool for RAG evaluations. Christy will talk about and demo evaluating a RAG pipeline using Milvus and RAG metrics like context F1-score and answer correctness.

Increase Quality with User Access Policies - July 2024

Peter Caitens

Recently uploaded (20)

DefCamp_2016_Chemerkin_Yury_--_publish.pdf

Mule Experience Hub and Release Channel with Java 17

FIDO Munich Seminar Introduction to FIDO.pptx

Demystifying Neural Networks And Building Cybersecurity Applications

Zaitechno Handheld Raman Spectrometer.pdf

NVIDIA at Breakthrough Discuss for Space Exploration

Top 12 AI Technology Trends For 2024.pdf

What's New in Teams Calling, Meetings, Devices June 2024

Keynote : Presentation on SASE Technology

How UiPath Discovery Suite supports identification of Agentic Process Automat...

Enterprise_Mobile_Security_Forum_2013.pdf

Mastering Board Best Practices: Essential Skills for Effective Non-profit Lea...

Keynote : AI & Future Of Offensive Security

TrustArc Webinar - Innovating with TRUSTe Responsible AI Certification

It's your unstructured data: How to get your GenAI app to production (and spe...

Self-Healing Test Automation Framework - Healenium

Generative AI technology is a fascinating field that focuses on creating comp...

What's New in Copilot for Microsoft 365 June 2024.pptx

Retrieval Augmented Generation Evaluation with Ragas

Increase Quality with User Access Policies - July 2024

How Netflix Builds High Performance Applications at Global Scale

1. HOSTED BY How Netflix Builds High Performance Applications at Global Scale Prasanna Vijayanathan Senior Software Engineer at Netflix

2. Prasanna Vijayanathan (he/him) Senior Software Engineer at Netflix ■ Something cool I’ve done ■ My perspective on P99s ■ Another thing about me ■ What I do away from work

3. Your app (phone, browser, TV, multiverse?)

4. Your app (phone, browser, TV, multiverse?)

5. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices

6. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs

7. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users

8. Understanding your application Observability and monitoring

9. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency

10. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency Tracking

11. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency Tracking

12. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency Tracking

13. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency Tracking

14. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users Errors, latency Tracking

18. User Experience

19. Your infrastructure Your app (phone, browser, TV, multiverse?) Reverse proxy/load balancer Data Microservices CDNs Users

20. Your app (phone, browser, TV, multiverse?) Users Engagement - Sessions - Time spent on app Environment - Platform - Device capabilities - Network conditions Experience - Time to load the app - Time to render - Video quality

22. App load time App load time

23. Diversity at scale

24. Diversity at scale Platform Memory Computing & efficiency Device Location Network Geo Needs Preferences Users

25. Diversity in devices • Web • Mobile • TV • Other devices (VR, Watches, Glasses,..) Platform • Crashes and errors • Storage • Buffering Memory • CPU/GPU • Energy consumption Computing and efficiency

26. Diversity in network • Ethernet, Fiber, WiFi, 4G, 5G Type of Network • 1000s of providers • different plans ISPs • bandwidth, throughput, errors Factors impacting networks

27. Diversity in Users • What does the user need from the app? User's needs • How does the user expect the app to behave? User's preferences

28. Consistency of QoE

29. Consistency of QoE Experience is relative Users like to get expected behavior

30. Consistency of QoE Provide the expected behavior every time Do better whenever possible

31. Consistency of QoE How to know what’s expected? User disruptions

32. User Disruptions Needs & Preferences Environment

33. Needs & Preferences App improvements New product offerings, features, performance Better feedback Lower support calls Longer sessions, more engagement User Needs & Preferences Distruptions Environment

34. Disruptions Errors, crashes Action fails Loading spinners User Disruptions Needs & Preferences Environment

35. Environment User Environment Needs & Preferences Device Make/model, platform, memory, CPU Network throughput, latency, errors Others time, location, seasonality Disruptions

36. User Disruptions Needs & Preferences Environment

37. How could we do this? QOE models ■ Devices ■ Networks ■ Disruption prediction Transfer learning ■ Learn what’s good and bad for each user

38. How could we do this? <Demo: building a model with a sample data set>

39. How could we do this? <Demo: Show using SHAP values for interpretability>

40. What’s possible? ■ Constant iteration and improvement ■ Automatic feature selection and experimentation ■ The best experience possible, every user, every time.

41. First Last email@address.com @twitter website/blog url Thank you! Let’s connect.

How Netflix Builds High Performance Applications at Global Scale

More Related Content

Similar to How Netflix Builds High Performance Applications at Global Scale

Similar to How Netflix Builds High Performance Applications at Global Scale (20)

More from ScyllaDB

More from ScyllaDB (20)

Recently uploaded

Recently uploaded (20)

How Netflix Builds High Performance Applications at Global Scale