Scalegrid

MAY 13, 2020

Greenplum Database is an open-source , hardware-agnostic MPP database for analytics, based on PostgreSQL and developed by Pivotal who was later acquired by VMware. Greenplum uses an MPP database design that can help you develop a scalable, high performance deployment. Greenplum Architectural Design. Open Source.

Big Data 321

Big Data Database Artificial Intelligence Open Source 321

Percona

APRIL 28, 2023

We are a company of open source proponents. We’re also dedicated and active participants in the global open source community. Both open source and proprietary options have advantages. With open source database software , anyone in the general public can access the source code, read it, and modify it.

Open Source 135

Open Source Database Software Software 135

DZone

DECEMBER 4, 2023

As organizations seek more robust, scalable, and reliable solutions for deploying and managing containerized applications , Kubernetes emerges as the clear frontrunner. Kubernetes , on the other hand, is an open-source platform designed to automate the deployment, scaling, and operation of application containers.

Best Practices 328

Best Practices Open Source Scalability Design 328

The Netflix TechBlog

DECEMBER 3, 2019

by David Berg , Ravi Kiran Chirravuri , Romain Cledat , Savin Goyal , Ferras Hamad , Ville Tuulos tl;dr Metaflow is now open-source! By design, Metaflow is a deceptively simple Python library: Data scientists can structure their workflow as a Directed Acyclic Graph of steps, as depicted above. Get started at metaflow.org.

Open Source 135

Open Source AWS Infrastructure Energy 135

Percona

MARCH 30, 2023

The use of open source databases has increased steadily in recent years. Past trepidation — about perceived vulnerabilities and performance issues — has faded as decision makers realize what an “open source database” really is and what it offers. What is an open source database?

Open Source 107

Open Source Database Storage Scalability 107

The Netflix TechBlog

MARCH 4, 2025

Data storage and distribution through HollowFeeds Netflix Hollow is an Open Source java library and toolset for disseminating in-memory datasets from a single producer to many consumers for high performance read-only access. Conclusion Throughout this series, weve explored the journey of enhancing title launch observability at Netflix.

Traffic 180

Traffic Strategy Entertainment Innovation 180

High Scalability

JANUARY 11, 2019

He designed the Merlin engine. No one knows Tom Mueller, even though Tom is the one currently designing a rocket that will put humans on Mars. ????‍??. Consume Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). Consume Explain the Cloud Like I'm 10 (35 nearly 5 star reviews). He's CTO of Propulsion. His name is Tom Mueller.

Internet 33

Internet Internet Scalability Open Source 33

Uber Engineering

MARCH 8, 2019

Peloton is designed for web-scale companies like Uber with millions of containers and tens of thousands of nodes. … The post Open Sourcing Peloton, Uber’s Unified Resource Scheduler appeared first on Uber Engineering Blog.

Open Source 109

Open Source Engineering Design Scalability 109

Dynatrace

OCTOBER 1, 2021

In these modern environments, every hardware, software, and cloud infrastructure component and every container, open-source tool, and microservice generates records of every activity. The architects and developers who create the software must design it to be observed. Making observability actionable and scalable for IT teams.

Metrics 363

Metrics Open Source Monitoring Cloud 363

Percona

OCTOBER 18, 2023

Migrating a proprietary database to open source is a major decision that can significantly affect your organization. Advantages of migrating to open source For many reasons mentioned earlier, organizations are increasingly shifting towards open source databases for their data management needs.

Open Source 111

Open Source Database Hardware Strategy 111

DZone

MARCH 22, 2023

Kubernetes (sometimes called K8s) is an open-source container-orchestration system that simplifies the deployment, scaling, and management of containerized applications. It is designed to be highly scalable, fault-tolerant, and cloud-agnostic, running on multiple cloud platforms and on-premise environments.

Open Source 253

Open Source Scalability Architecture Cloud 253

Dynatrace

JUNE 9, 2021

Web application security is the process of protecting web applications against various types of threats that are designed to exploit vulnerabilities in an application’s code. Data from Forrester Research provides more detail, finding that 39% of all attacks were designed to exploit vulnerabilities in web applications.

Open Source 261

Open Source Entertainment Tuning Internet 261

High Scalability

SEPTEMBER 28, 2018

Or, maybe, they can succeed as in getting comfy job at IBM, but their designs don't translate into useful products. Don't miss all that the Internet has to say on Scalability, click below and become eventually consistent with all scalability knowledge (which means this post has many more items to read so please keep on reading).

Internet 35

Internet Internet Scalability Blockchain 35

Dynatrace

MARCH 17, 2021

Application security is a software engineering term that refers to several different types of security practices designed to ensure applications do not contain vulnerabilities that could allow illicit access to sensitive data, unauthorized code modification, or resource hijacking. How open-source packages have changed the game.

Open Source 242

Open Source Cloud Games Java 242

Dynatrace

JUNE 13, 2022

Open source code, for example, has generated new threat vectors for attackers to exploit. A case in point is Log4Shell, which emerged in late 2021 and exposed open source libraries to exploitation. Dynatrace introduces automatic vulnerability management for PHP open source scripting language – blog.

Open Source 246

Open Source DevOps Java Innovation 246

InfoQ

FEBRUARY 11, 2024

Pinterest open-sourced its generic PubSub client library, PSC, which has been heavily used in production for a year and a half. The library helped the engineering teams by increasing developer velocity, and the scalability and stability of services using it. By Rafal Gancarz

Open Source 103

Open Source Java Scalability Engineering 103

Dynatrace

OCTOBER 7, 2020

Open-source metric sources automatically map to our Smartscape model for AI analytics. Telegraf is an open-source agent by Influxdata. Scalable and easy Prometheus support for Kubernetes. By directly and automatically feeding Prometheus data from metric exporters, Dynatrace solves the scalability problem.

Open Source 264

Open Source Metrics Analytics Tuning 264

Dynatrace

DECEMBER 8, 2022

They are similar to site reliability engineers (SREs) who focus on creating scalable, highly reliable software systems. Version control system and source code management with end-to-end DevOps platform and cloud-hosted Git services. Open source CI/CD pipeline tool with extensible server automation for distributed builds and scaling.

DevOps 246

DevOps Engineering Testing Open Source 246

High Scalability

DECEMBER 21, 2018

It's HighScalability time: Have a very scalable Xmas everyone! kellabyte : “Open source” infrastructure companies are a giant s**t show right now. See you in the New Year. Do you like this sort of Stuff? Please support me on Patreon. I'd really appreciate it. Still looking for that perfect xmas gift? Don't be late.

Internet 137

Internet Internet Scalability Serverless 137

The Netflix TechBlog

MAY 19, 2023

By Chris Wolfe , Joey Schorr , and Victor Roldán Betancort Introduction The authorization team at Netflix recently sponsored work to add Attribute Based Access Control (ABAC) support to AuthZed’s open source Google Zanzibar inspired authorization system, SpiceDB. What was problematic about this design?

Cache 255

Cache Google Open Source Systems 255

All Things Distributed

MARCH 19, 2018

At AWS, we continue to strive to enable builders to build cutting-edge technologies faster in a secure, reliable, and scalable fashion. While building Amazon SageMaker and applying it for large-scale machine learning problems, we realized that scalability is one of the key aspects that we need to focus on. Streaming algorithms.

Scalability 127

Scalability Hardware AWS Tuning 127

Dynatrace

NOVEMBER 7, 2023

The old saying in the software development community, “You build it, you run it,” no longer works as a scalable approach in the modern cloud-native world. The ability to effectively manage multi-cluster infrastructure is critical to consistent and scalable service delivery. Automation, automation, automation.

Engineering 306

Engineering DevOps Best Practices Infrastructure 306

Dynatrace

MAY 23, 2024

This high level of abstraction is provided by industry-grade, open source stream processing frameworks such as Kafka Streams , Apache Flink , and Spark Structured Streaming. Such frameworks support software engineers in building highly scalable and efficient applications that process continuous data streams of massive volume.

Engineering 245

Engineering Tuning Latency Open Source 245

InfoQ

SEPTEMBER 11, 2023

LinkedIn developed a new open-source service called "iris-message-processor" to enhance the performance and reliability of its existing Iris escalation management system. iris-message-processor" significantly improves processing speeds, being ~4.6x faster under average loads and ~86.6x faster under high loads than its predecessor.

Open Source 99

Open Source Speed Systems Processing 99

Dynatrace

SEPTEMBER 27, 2024

Option 1: Build a custom solution using several (open source) frameworks Do-it-yourself (DIY) was the only option before composable enterprise software platforms became popular. Faced with these requirements, Omnilogy carefully evaluated the following two options for implementing a solution to the pipeline observability challenge.

Government 246

Government DevOps Azure Scalability 246

The Netflix TechBlog

NOVEMBER 22, 2019

This entertaining romp through the tech stack serves as an introduction to how we think about and design systems, the Netflix approach to operational challenges, and how other organizations can apply our thought processes and technologies. Technology advancements in content creation and consumption have also increased its data footprint.

AWS 38

AWS Entertainment Open Source Benchmarking 38

Dynatrace

JUNE 10, 2024

Security analytics solutions are designed to handle modern applications that rely on dynamic code and microservices. This includes everything from multicloud deployments to microservices to Kubernetes instances and the use of open source software. Infrastructure type In most cases, legacy SIEM tools are on-premises.

Analytics 264

Analytics Network Open Source Hardware 264

Dynatrace

JUNE 27, 2023

Centralized log management for scalable ingestion into Grail As AWS S3 proves to be the preferred way of storing cloud logs, enterprise customers face mounting challenges in putting S3 log data to use. To date, some customers have used open source or community-backed components to forward logs from S3 to Dynatrace.

AWS 246

AWS Cloud Lambda Analytics 246

Dynatrace

JULY 7, 2022

As the demand for services grows and containerized applications deploy across multicloud environments, organizations need a more flexible, cohesive approach for designing and developing a distributed systems architecture. Experienced developers see microservice design patterns as more platform-agnostic. Systems monitoring and alerting.

Architecture 246

Architecture Serverless Azure Programming 246

Dynatrace

MAY 7, 2024

Fluent Bit is a telemetry agent designed to receive data (logs, traces, and metrics), process or modify it, and export it to a destination. Fluent Bit was designed to help you adjust your data and add the proper context, which can be helpful in the observability backend. What’s the difference between Fluent Bit and Fluentd?

Best Practices 279

Best Practices IoT Metrics Storage 279

The Netflix TechBlog

MARCH 7, 2024

The Machine Learning Platform (MLP) team at Netflix provides an entire ecosystem of tools around Metaflow , an open source machine learning infrastructure framework we started, to empower data scientists and machine learning practitioners to build and manage a variety of ML systems.

Systems 235

Systems Media Cache Open Source 235

The Netflix TechBlog

OCTOBER 19, 2020

Now let’s look at how we designed the tracing infrastructure that powers Edgar. Troubleshooting a session in Edgar When we started building Edgar four years ago, there were very few open-source distributed tracing systems that satisfied our needs. Mantis is our go-to platform for processing operational data at Netflix.

Infrastructure 238

Infrastructure Transportation Storage Open Source 238

The Netflix TechBlog

NOVEMBER 23, 2020

In order to design, operate, and measure these networks, we must collect metrics and state data from the thousands of devices that compose them. Towards this end, we created gnmi-gateway , which we have released as an open source project. which, for time series data, must be driven by a strict clock.

Open Source 188

Open Source Network Transportation Cache 188

Dynatrace

JANUARY 31, 2024

The exponential growth of data volume—including observability, security, software lifecycle, and business data—forces organizations to deal with cost increases while providing flexible, robust, and scalable ingest. Figure 2: Configuration and ingest throughput for each source, grouped by type Protect your sensitive data Privacy by design.

Analytics 272

Analytics Processing Transportation Storage 272

The Netflix TechBlog

DECEMBER 11, 2020

For general GraphQL questions, we lean on the open source community plus cultivate an internal GraphQL community to discuss hot topics like pagination, error handling, nullability, and naming conventions. The DGS framework is planned to be open-sourced in early 2021. We prioritized three areas: Alerting ?—?report

Architecture 255

Architecture Best Practices Engineering Open Source 255

Dynatrace

OCTOBER 4, 2022

This openness is accompanied by reduced data quality which limits the value of analyses run on data lakes. A data lakehouse addresses these limitations and introduces an entirely new architectural design. From the beginning, Grail was built to be fast and scalable to manage massive volumes of data. Ingest and process with Grail.

Artificial Intelligence 290

Artificial Intelligence Analytics Storage Architecture 290

Dynatrace

NOVEMBER 22, 2021

EC2 is Amazon’s Infrastructure-as-a-service (IaaS) compute platform designed to handle any workload at scale. AWS Lambda makes it easy to design, run, and maintain application systems without having to provision or manage infrastructure. Here are a few of the most popular. Amazon EC2. Amazon Fargate.

Best Practices 246

Best Practices AWS Monitoring Serverless 246