March, 2019

article thumbnail

How is software developed at Amazon?

High Scalability

How is software developed at Amazon? Get a couple of prime pizzas delivered and watch this excellent interview with Ken Exner, GM of AWS Developer Tools. It's notable Ken is from the tools group, because progress in an industry is almost always made possible by the development of better tools. The key themes from the talk: decomposition, automation, and organize around the customer.

Software 279
article thumbnail

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use

Scalegrid

Wondering which databases are trending in 2019? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year.

Database 255
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and Efficiency By: Di Lin , Girish Lingappa , Jitender Aswani Imagine yourself in the role of a data-inspired decision maker staring at a metric on a dashboard about to make a critical business decision but pausing to ask a question?—?“Can I run a check myself to understand what data is behind this metric?

article thumbnail

Amazon Aurora ascendant: How we designed a cloud-native relational database

All Things Distributed

Relational databases have been around for a long time. The relational model of data was pioneered back in the 1970s by E.F. Codd. The core technologies underpinning the major relational database management systems of today were developed in the 1980–1990s. Relational database fundamentals, including data relationships, ACID (Atomicity, Consistency, Isolation, Durability) transactions, and the SQL query language, have stood the test of time.

Database 144
article thumbnail

Don’t read your data from a straw

Daniel Lemire

It is common for binary data to be serialized to bytes. Data structures like indexes can be saved to disk or transmitted over the network in such a form. Many serialized data structures can be viewed as sets of ‘integer’ values. That is the case, for example, of a Roaring bitmap. We must then read back this data. An integer could be serialized as four bytes in a stream of bytes.

Java 124
article thumbnail

The Client/Server Rendering Spectrum

CSS - Tricks

I've definitely been guilty of thinking about rendering on the web as a two-horse race. There is Server-Side Rendering (SSR, like this WordPress site is doing) and Client-Side Rendering (CSR, like a typical React app). Both are full of advantages and disadvantages. But, of course, the conversation is more nuanced. Just because an app is SSR doesn't mean it doesn't do dynamic JavaScript-powered things.

Servers 109
article thumbnail

2019 Database Trends – SQL vs. NoSQL, Top Databases, Single vs. Multiple Database Use

High Scalability

Wondering which databases are trending in 2019 ? We asked hundreds of developers, engineers, software architects, dev teams, and IT leaders at DeveloperWeek to discover the current NoSQL vs. SQL usage, most popular databases, important metrics to track, and their most time-consuming database management tasks. Get the latest insights on MySQL , MongoDB , PostgreSQL , Redis , and many others to see which database management systems are most favored this year.

Database 278

More Trending

article thumbnail

Spinnaker Sets Sail to the Continuous Delivery Foundation

The Netflix TechBlog

Author: Andy Glover Since releasing Spinnaker to the open source community in 2015 , the platform has flourished with the addition of new cloud providers, triggers, pipeline stages, and much more. Myriad new features, improvements, and innovations have been added by an ever growing, actively engaged community. Each new innovation has been a step towards an even better Continuous Delivery platform that facilitates rapid, reliable, safe delivery of flexible assets to pluggable deployment targets.

article thumbnail

Amazon Aurora ascendant: How we designed a cloud-native relational database

All Things Distributed

Relational databases have been around for a long time. The relational model of data was pioneered back in the 1970s by E.F. Codd. The core technologies underpinning the major relational database management systems of today were developed in the 1980–1990s. Relational database fundamentals, including data relationships, ACID (Atomicity, Consistency, Isolation, Durability) transactions, and the SQL query language, have stood the test of time.

Database 146
article thumbnail

Rendering large lists with react-window

Addy Osmani

If you use React and need to display large lists of data efficiently , you may be familiar with react-virtualized. It's a windowing library by Brian Vaughn that renders only the items currently visible in a list (within a scrolling "viewport"). This means you don't need to pay the cost of thousands of rows of data being rendered at once.

article thumbnail

Open Sourcing Peloton, Uber’s Unified Resource Scheduler

Uber Engineering

First introduced by Uber in November 2018, Peloton , a unified resource scheduler, manages resources across distinct workloads, combining separate compute clusters. Peloton is designed for web-scale companies like Uber with millions of containers and tens of thousands of nodes. … The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 29th, 2019

High Scalability

Wake up! It's HighScalability time: Uber's microservice Graph. Thousands of microservices. Crazy like a fox? Or just crazy? ( @msuriar ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. I wrote Explain the Cloud Like I'm 10 for people who need to understand the cloud. And who doesn't these days? On Amazon it has 42 mostly 5 star reviews (100 on Goodreads).

Internet 198
article thumbnail

Web Development Trends 2019

KeyCDN

Smart developers are always looking ahead for ways to adapt in the ever changing world of web development. As trends emerge, new opportunities will arise. No one could have imagined what the web would look like today 20 years ago, so who knows what the coming decades will hold. Staying on top of the latest web development trends could eventually help you land a job that doesn’t exist yet.

article thumbnail

How Data Inspires Building a Scalable, Resilient and Secure Cloud Infrastructure At Netflix

The Netflix TechBlog

Netflix’s engineering culture is predicated on Freedom & Responsibility, the idea that everyone (and every team) at Netflix is entrusted with a core responsibility and they are free to operate with freedom to satisfy their mission. This freedom allows teams and individuals to move fast to deliver on innovation and feel responsible for quality and robustness of their delivery.

article thumbnail

Redefining application communications with AWS App Mesh

All Things Distributed

At re:Invent 2018, AWS announced the AWS App Mesh public preview, a service mesh that allows you to easily monitor and control communications across applications. Today, I'm happy to announce that App Mesh is generally available for use by customers. New architectural patterns. Many customers are modernizing their existing applications to become more agile and innovate faster.

AWS 131
article thumbnail

Experimenting with the Streams API

Dean Hume

I am always looking for ways to build faster, slicker web pages. Where applicable, I’ll use great new browser features such as service workers, HTTP/2 and improved compression, just to name a few. But what if I told you there was a way to build even faster web pages? I’d like to introduce you to the Streams API. Before we go any further, let’s go right back to basics.

article thumbnail

Using Machine Learning to Ensure the Capacity Safety of Individual Microservices

Uber Engineering

Reliability engineering teams at Uber build the tools, libraries, and infrastructure that enable engineers to operate our thousands of microservices reliably at scale. At its essence, reliability engineering boils down to actively preventing outages that affect the mean time between … The post Using Machine Learning to Ensure the Capacity Safety of Individual Microservices appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 8th, 2019

High Scalability

Wake up! It's HighScalability time: A highly simplified diagram of serverless. ( @jbesw ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 40 mostly 5 star reviews. They'll learn a lot and love you even more. 5% : France's new digital tax revolution; $15 trillion : AI contribution to global GDP by 2030; 70% : better response time using HTTP keep-alive in lambda; 115 million :

Internet 146
article thumbnail

Expanding Our Horizons - Efficiently

Edge Perspectives

In our Big Shift world, we confront the imperative of institutional innovation – shifting from institutional models built on scalable efficiency to institutional models built on scalable learning. I’ve written and spoken about this a lot over the years and one of the most common pushbacks I get is – “so, are you against efficiency?” This post seeks to answer that question.

article thumbnail

Netflix Public Bug Bounty, 1 year later

The Netflix TechBlog

by Astha Singhal (Netflix Application Security) As Netflix continues to create entertainment people love, the security team continues to keep our members, partners, and employees secure. The security research community has partnered with us to improve the security of the Netflix service for the past few years through our responsible disclosure and bug bounty programs.

article thumbnail

Lazy Loading, faster webpages, SEO friendly

Dareboost

Images are a key content on your website? If you’re serious about your website performance, you have probably optimized them. But have you considered to lazy load your images? Lazy loading images improves the user experience by saving bandwidth for important content first. Some reject the technique for SEO considerations.

article thumbnail

Top 8 Best Backend Frameworks

KeyCDN

There are a myriad of options available when choosing which backend framework you want to work with. Although each backend framework comes with its own set of pros and cons, there are also a few other factors you’ll want to take into consideration before making a final decision. In this guide, we’ll take a closer look at both tried and true as well as newer frameworks to help you decide which is the best backend framework for you.

article thumbnail

Improving the User Experience with Uber’s Customer Obsession Ticket Routing Workflow and Orchestration Engine

Uber Engineering

Every day, Uber users around the world initiate customer support tickets through our Customer Obsession Platform. To ensure a seamless user experience, each of those tickets must be matched with an agent who speaks the user’s language and who … The post Improving the User Experience with Uber’s Customer Obsession Ticket Routing Workflow and Orchestration Engine appeared first on Uber Engineering Blog.

article thumbnail

Stuff The Internet Says On Scalability For March 22nd, 2019

High Scalability

Wake up! It's HighScalability time: Van Gogh? Nope. A satellite image of phytoplankton populations or algae blooms in the Baltic Sea. ( NASA ). Do you like this sort of Stuff? I'd greatly appreciate your support on Patreon. Know anyone who needs cloud? I wrote Explain the Cloud Like I'm 10 just for them. It has 41 mostly 5 star reviews. They'll learn a lot and love you even more.5 billion : weekly visits to Apple App store; $500m : new US exascale computer; $1.7 billion : EU's newest fine on Goo

Internet 134
article thumbnail

A Note to Business Leaders on Software Engineering

Strategic Tech

Software developers are interchangeable. A software developer with a computer science degree will produce the same quality of work as any other software developer with a computer science degree. It makes business sense to hire cheap programmers and put in place a standard process. If that sounds like something you would say or think, then your perception of software development is severely detrimental to the health of your business.

article thumbnail

Trace Event, Chrome and More Profile Formats on FlameScope

The Netflix TechBlog

FlameScope sub-second heatmap visualization. Less than a year ago, FlameScope was released as a proof of concept for a new profile visualization. Since then, it helped us, and many other users, to easily find and fix performance issues, and allowed us to see patterns that we had never noticed before in our profiles. As a tool, FlameScope was limited.

Storage 100
article thumbnail

Home Automation Using the Internet of Things (IoT) – 2019

Simform

Read the tutorial blog on how to implement Home Automation using IoT. It covers the software, hardware, sensors, protocols, architecture and platforms. Applications of IoT-enabled connectivity are home security, air quality monitoring, infotainment delivery, smart lock etc. The post Home Automation Using the Internet of Things (IoT) – 2019 appeared first on Insights on Latest Software Technologies - Simform Blog.

IoT 75
article thumbnail

The 737Max and Why Software Engineers Might Want to Pay Attention

J. Paul Reed

The 737Max and Why Software Engineers Might Want to Pay Attention As someone with a bit of a reputation for talking about aviation and software development and operations , I’ve been asked about the 737Max repeatedly over the past week. I’ve been watching this story develop since November of last year, when the Lion Air 737Max crashed. Given recent developments, if you want a pure-aviation take on what’s going, there are better people to ask.

article thumbnail

The 10 Must-Track Web Performance Metrics

MachMetrics

Web performance metrics track the efficiency (or lack thereof) of any individual aspect of your website’s performance. The first step in improving your website is measuring it. Web analytics such as click-through rates, bounce rates, website business transactions and sales, response times, web server usage, social media interaction, and many other key performance indicators will help ensure your site is optimal.

Metrics 74
article thumbnail

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure.

Software 122
article thumbnail

Two-Factor Authentication With TOTP Using Node.js And Speakeasy

The Polyglot Developer

Almost two years ago I had written a tutorial around 2FA in a Node.js API with time-based one-time passwords. If you’re unfamiliar, two-factor authentication is becoming the norm, which it wasn’t necessarily back in 2017. If you’re managing user accounts in your web applications, it is critical that you offer your users a second factor of authentication to prevent phishing and malicious login attempts.

article thumbnail

You don't need ordered delivery

Particular Software

In our family it's a tradition that you get to decide what we'll have for dinner when it's your birthday. On my daughter's last birthday, she picked pizza. I took her to the nearby pizza shop to decide what pizza to get. A large screen dominates one wall of the pizza place, showing each order as it progresses through each stage of preparation. As I was looking at the screen, I noticed some names suddenly switched.

article thumbnail

How to Make an app like Airbnb : Develop your own Vacation Rental App

Simform

My take on making an app like Airbnb, leveraging my experience of working with 50+ Airbnb type app startups. Learn everything that you need to build and develop an app like Airbnb for vacation rental. The post How to Make an app like Airbnb : Develop your own Vacation Rental App appeared first on Insights on Latest Software Technologies - Simform Blog.

article thumbnail

A tester's guide to leveraging Kubernetes

TechBeacon Testing

With the advent of agile and DevOps, organizations are moving from specialized roles to cross-functional teams—and that means cross-functional sharing of the specialized tools used in each silo.

DevOps 66
article thumbnail

Performance Budgets That Stick

Tim Kadlec

Occasionally I hear some chatter about performance budgets “not working.” And, to be fair, I have seen companies who adopt a budget and then are unable to make meaningful improvements towards that goal. Over time those ineffective budgets get pushed to the sideline where they accumulate dust before being forgotten about altogether. It’s not really about the performance budget, though.

article thumbnail

Sponsored Post: Software Buyers Council, InMemory.Net, Triplebyte, Etleap, Stream, Scalyr

High Scalability

Who's Hiring? Triplebyte lets exceptional software engineers skip screening steps at hundreds of top tech companies like Apple, Dropbox, Mixpanel, and Instacart. Make your job search O (1), not O ( n ). Apply here. Need excellent people? Advertise your job here! Fun and Informative Events. Join Etleap , an Amazon Redshift ETL tool to learn the latest trends in designing a modern analytics infrastructure.

Software 116
article thumbnail

Zoom In Filters for High Impact

Edge Perspectives

Small moves, smartly made, can set big things in motion. That’s a key to succeeding in a world of mounting performance pressure. In a previous post , I briefly alluded to the need to “zoom out” to smartly make small moves. In today’s post, I want to focus in more detail on the need to zoom in. Zoom out/zoom in strategies                         �