Scalegrid

MARCH 14, 2024

Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution. Defining Hybrid Cloud Strategy The decision-making process about where to situate data and applications is vital to any hybrid cloud solution.

Strategy 130

Strategy Cloud Artificial Intelligence Infrastructure 130

The Netflix TechBlog

MAY 26, 2020

Service Segmentation: The ease of the cloud deployments has led to the organic growth of multiple AWS accounts, deployment practices, interconnection practices, etc. VPC Flow Logs VPC Flow Logs is an AWS feature that captures information about the IP traffic going to and from network interfaces in a VPC.

Network 152

Network Tuning AWS Traffic 152

All Things Distributed

JUNE 26, 2016

In June 2015, Amazon Web Services announced that it would launch a new AWS infrastructure region in India. Examples of continuous sensing are found in the managed cloud platform built by Rachio on AWS IoT to enable the secure interaction of its connected devices with cloud applications/other devices. The opportunity to revolutionize.

AWS 82

AWS Cloud Healthcare Blockchain 82

The Netflix TechBlog

MARCH 25, 2019

We adopted the following mission statement to guide our investments: “Provide a complete and accurate data lineage system enabling decision-makers to win moments of truth.” Nonetheless, Netflix data landscape (see below) is complex and many teams collaborate effectively for sharing the responsibility of our data system management.

Infrastructure 223

Infrastructure Big Data Transportation Architecture 223

All Things Distributed

SEPTEMBER 26, 2014

The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. The AWS Loft is all about helping you scale and grow your business by offering free AWS technical resources. Take a look at the AWS Loft homepage. What’s Happening at the AWS Loft.

AWS 104

AWS Games Education Innovation 104

Dynatrace

JANUARY 16, 2023

Most Kubernetes clusters in the cloud (73%) are built on top of managed distributions from the hyperscalers like AWS Elastic Kubernetes Service (EKS), Azure Kubernetes Service (AKS), or Google Kubernetes Engine (GKE). Big data : To store, search, and analyze large datasets, 32% of organizations use Elasticsearch.

Open Source 351

Open Source Java Operating System Programming 351

All Things Distributed

MAY 27, 2015

Over a year ago the AWS team opened a "pop-up loft" in San Francisco at 925 Market Street. The goal of opening the loft was to give developers an opportunity to get in-person support and education on AWS, to network, get some work done, or just hang out with peers. Usually $30 each, these labs are offered for free in the AWS loft.

AWS 85

AWS Education Big Data Games 85

Dynatrace

APRIL 11, 2023

Cloud application security remains challenging because organizations lack end-to-end visibility into cloud architecture. As organizations migrate applications to the cloud, they must balance the agility that microservices architecture brings with the complexity and lack of transparency that can also come with it.

Cloud 200

Cloud DevOps Open Source Retail 200

The Netflix TechBlog

OCTOBER 18, 2022

by Jun He , Akash Dwivedi , Natallia Dzenisenka , Snehal Chennuru , Praneeth Yenugutala , Pawan Dixit At Netflix, Data and Machine Learning (ML) pipelines are widely used and have become central for the business, representing diverse use cases that go beyond recommendations, predictions and data transformations.

Java 208

Java Scalability Traffic Architecture 208

All Things Distributed

JULY 16, 2012

Register for AWS re: Invent. The first annual AWS user and partner conference will be held November 27-29 at The Venetian in Las Vega. General registration opens up on July 25, 2012, however active AWS customers will get a chance to jump the line and start registering on July 20. All Things Distributed. Comments ().

AWS 75

AWS Big Data Media Storage 75

The Netflix TechBlog

OCTOBER 27, 2020

Usually Data scientists and engineers write Extract-Transform-Load (ETL) jobs and pipelines using big data compute technologies, like Spark or Presto , to process this data and periodically compute key information for a member or a video. The processed data is typically stored as data warehouse tables in AWS S3.

Latency 249

Latency Storage Big Data Tuning 249

High Scalability

MAY 26, 2020

Scrapinghub is hiring a Senior Software Engineer (Big Data/AI). You will be designing and implementing distributed systems : large-scale web crawling platform, integrating Deep Learning based web data extraction components, working on queue algorithms, large datasets, creating a development platform for other company departments, etc.

Education 100

Education AWS Software Engineering Scalability 100

All Things Distributed

AUGUST 19, 2011

Job Openings in AWS - Senior Leader in Database Services. This week it is an opening for senior leaders with AWS Database Services. AWS Database Services is responsible for setting the database strategy and delivering distributed structured storage services to our AWS customers. Countdown to What is Next in AWS.

AWS 70

AWS Database Storage Scalability 70

All Things Distributed

SEPTEMBER 6, 2013

This spring I travelled through Europe for the AWS Global Summit series. Europe is a continent with much diversity and for each country there are great AWS customer examples to tell. To reach those goals, Shell in 2010 began using AWS. These sensors create massive amounts of geological data.

Cloud 117

Cloud Energy AWS Healthcare 117

All Things Distributed

APRIL 27, 2011

To our shareowners: Random forests, naïve Bayesian estimators, RESTful services, gossip protocols, eventual consistency, data sharding, anti-entropy, Byzantine quorum, erasure coding, vector clocks. Look inside a current textbook on software architecture, and youll find few patterns that we dont apply at Amazon. All postings.

Technology 142

Technology Technology AWS Storage 142

All Things Distributed

NOVEMBER 15, 2010

Building general purpose architectures has always been hard; there are often so many conflicting requirements that you cannot derive an architecture that will serve all, so we have often ended up focusing on one side of the requirements that allow you to serve that area really well. From CPU to GPU.

AWS 130

AWS Programming Latency Architecture 130

The Netflix TechBlog

DECEMBER 21, 2020

By Anupom Syam Background At Netflix, our current data warehouse contains hundreds of Petabytes of data stored in AWS S3 , and each day we ingest and create additional Petabytes. Then deep dive into the merging use case of AutoOptimize and share some results and benefits.

Storage 209

Storage Latency Efficiency Data Engineering 209

All Things Distributed

MARCH 28, 2011

The service is designed to sustain concurrent device failures by quickly detecting and repairing any lost redundancy, for example there may be a concurrent loss of data in two facilities without the customer ever noticing. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. All postings.

AWS 131

AWS Cloud Storage Internet 131

All Things Distributed

SEPTEMBER 30, 2010

With existing customers I get a change to dive deep on their AWS usage and understand what works well and where we can do better. Visiting future customers is equally exiting as you get a change to understand their current architecture, if it is a migration, and how they plan to exploit cloud services in their new setup. All postings.

AWS 70

AWS Cloud Storage Best Practices 70

The Morning Paper

JUNE 23, 2019

After all, we’ve been doing that forever with the 2nd-level cache of ORMs , and it is highly encouraged in e.g. the AWS Lambda programming model — which was born on the cloud— to help mitigate function start-up times. We’ve seen similar high marshalling overheads in big data systems too.) What is that something?

Cache 79

Cache Latency Google Network 79

All Things Distributed

NOVEMBER 19, 2010

Understanding Throughput-Oriented Architectures - background article in CACM on massively parallel and throughput vs latency oriented architectures. The Big Idea: Biomimetic Architecture - The National Geographic came in the mail this week with a beautiful pull-out of Gaudís Sagrada Família, the online version is only a summary.

AWS 64

AWS Cloud Benchmarking Storage 64

All Things Distributed

JULY 13, 2010

Additionally, many high-end HPC applications take advantage of knowing their in-house hardware platforms to achieve major speedup by exploiting the specific processor architecture. Driving Storage Costs Down for AWS Customers. Expanding the Cloud - The AWS Storage Gateway. Countdown to What is Next in AWS. until today.

Cloud 110

Cloud AWS Automotive Latency 110

All Things Distributed

DECEMBER 20, 2017

Marketers use big data and artificial intelligence to find out more about the future needs of their customers. Breuninger, a fashion department store chain steeped in tradition, has recognized this and relies on a self-developed e-commerce platform in the AWS Cloud.

Artificial Intelligence 74

Artificial Intelligence Social Media Logistics AWS 74

All Things Distributed

DECEMBER 5, 2010

Route 53 has the business properties that you have come to expect from an AWS service: fully self-service and programmable, with transparent pay-as-you-go pricing and no minimum usage commitments. If you want to learn more about Route 53 visit [link] and read the blog post at the AWS Developer weblog. Countdown to What is Next in AWS.

Cloud 116

Cloud Internet Internet AWS 116

The Netflix TechBlog

OCTOBER 15, 2019

In Netflix the microservice architecture is widely adopted and each microservice typically handles only one type of data. The core movie data resides in a microservice called Movie Service, and related data such as movie deals, talents, vendors and so on are managed by multiple other microservices (e.g

Transportation 196

Transportation Architecture Processing Storage 196

All Things Distributed

NOVEMBER 15, 2016

As I mentioned, we live in a world where massive volumes of data are being generated, every day, from connected devices, websites, mobile apps, and customer applications running on top of AWS infrastructure. Auto-discovery : One of the challenges with BI is discovering and accessing the data. Enter Amazon QuickSight.

Analytics 141

Analytics Availability Media Social Media 141