Remove Exercise Remove Processing Remove Software Architecture
article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. In many other frameworks, loading and storing of artifacts is left as an exercise for the user, which forces them to decide what should and should not be persisted.

article thumbnail

Building High-Quality Software

DZone

It’s much better to build your process around quality checks than retrofit these checks into the existent process. NIST did classic research to show that catching bugs at the beginning of the development process could be more than ten times cheaper than if a bug reaches production. A side note.

Software 245
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Highlights from the O'Reilly Software Architecture Conference in New York 2018

O'Reilly Software

Watch highlights covering the latest tools and techniques of software architecture. From the O'Reilly Software Architecture Conference in New York 2018. Experts from across the software architecture world came together in New York for the O'Reilly Software Architecture Conference.

article thumbnail

Open-Sourcing Metaflow, a Human-Centric Framework for Data Science

The Netflix TechBlog

mainly because of mundane reasons related to software engineering. We heard many stories about difficulties related to data access and basic data processing. In many other frameworks, loading and storing of artifacts is left as an exercise for the user, which forces them to decide what should and should not be persisted.

article thumbnail

MLOps and DevOps: Why Data Makes It Different

O'Reilly

While there isn’t an authoritative definition for the term, it shares its ethos with its predecessor, the DevOps movement in software engineering: by adopting well-defined processes, modern tooling, and automated workflows, we can streamline the process of moving from development to robust production deployments.

DevOps 140
article thumbnail

Amazon EC2 Cluster GPU Instances - All Things Distributed

All Things Distributed

From financial processing and traditional oil & gas exploration HPC applications to integrating complex 3D graphics into online and mobile applications, the applications of GPU processing appear to be limitless. Because of its focus on latency, the generic CPU yielded rather inefficient system for graphics processing.

AWS 127
article thumbnail

Educating a New Generation of Workers

O'Reilly

Too many students graduate thinking that science is a set of facts rather than understanding that it’s a process of skeptical inquiry driven by experiment. Teaching students to consider problems from many perspectives, including those that are uncomfortable, is a necessity. First, we find the top words associated with each topic.