Remove c
article thumbnail

Building and Scaling Data Lineage at Netflix to Improve Data Infrastructure Reliability, and…

The Netflix TechBlog

In the rest of this blog, we will a) touch on the complexity of Netflix cloud landscape, b) discuss lineage design goals, ingestion architecture and the corresponding data model, c) share the challenges we faced and the learnings we picked up along the way, and d) close it out with “what’s next” on this journey. come join us.

article thumbnail

Data Mining Problems in Retail

Highly Scalable

More specialized data mining applications like supply chain optimization and fraud detection are out of scope, as well as the implementation details of the data mining process (such as evaluation of model quality). Outputs of this tier can be used to configure downstream processes.

Retail 152
Insiders

Sign Up for our Newsletter

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

article thumbnail

Solaris to Linux Migration 2017

Brendan Gregg

There's also a ZFS send/recv code path that should try to use the TASK_INTERRUPTIBLE flag (as suggested by a coworker), to avoid a kernel hang (can't kill -9 the process). Hit Ctrl-C to end. ^C On Linux, containers are a combination of namespaces (restricting what a process sees) and cgroups (similar to Solaris resource controls).

article thumbnail

What Adrian Did Next?—?Part 2?—?Sun Microsystems

Adrian Cockcroft

I was mostly coding in C, tuning FORTRAN, and when I needed to do a lot of data analysis of benchmark results used the S-PLUS statistics language, that is the predecessor to R. I’d helped eBay recover from capacity related outages in 1999 and had setup their capacity planning processes. He had it up and running on Wednesday.

Tuning 52
article thumbnail

Netflix: A Culture of Learning

The Netflix TechBlog

There is broad buy-in across the company, including from the C-Suite, that, whenever possible, results from A/B tests or other causal inference approaches are near-requirements for decision making. our first investments in tooling to support A/B tests came way back in 2001. Early experimentation tooling at Netflix, from 2001.

Education 245