2019-11-21 16:36:04 +02:00

25 KiB

Raw Blame History

Awesome DevOps

A curated list of awesome DevOps tools, technologies, platforms and resources. Things to help/grow you in DevOps or SRE area.

Awesome DevOps

Cloud Platforms

Public and Private Cloud Platforms.

Amazon Web Services (AWS) - Cloud Computing Services.
Google Cloud Platform (GCP) - Cloud Computing Services.
Azure - Cloud Computing Platform & Services.
Alibaba Cloud - integrated suite of cloud products and services.
Oracle Cloud - comprehensive and fully integrated stack of cloud applications and platform services.
DigitalOcean - helping developers easily build, test, manage, and scale applications of any size.
Scaleway - single way to create, deploy and scale your infrastructure in the cloud.
Vultr - easily deploy cloud servers, bare metal, and storage worldwide.
VMware Cloud - run, manage, connect and protect all of your apps on any cloud.

Open Source Cloud Platforms

Private, Public and Hybrid open source Cloud Platforms.

Openstack - open source software for creating private and public clouds.
Apache CloudStack - designed to deploy and manage large networks of virtual machines.
OpenNebula - build Private Clouds and manage Data Center virtualization based on KVM, LXD and VMware.
Eucalyptus - building AWS-compatible private and hybrid clouds.
DC/OS - distributed operating system based on the Apache Mesos distributed systems kernel.
Apache Mesos - program against your datacenter like it’s a single pool of resources.

Operating Systems

Operating Systems - Server Platform.

Ubuntu
CentOS
CoreOS - the pioneering lightweight container host.
OSv - versatile modular unikernel designed to run unmodified Linux applications securely on micro-VMs in the cloud.
Rancher OS - a lightweight, secure Linux distribution, built from containers to run containers well.
Atomic - use immutable infrastructure to deploy and scale your containerized applications.
Photon - Linux container host optimized for cloud-native applications, cloud platforms, and VMware infrastructure.

Distributed Filesystems

Network distributed filesystems.

Chep - highly scalable object, block and file-based storage under one whole system.
Gluster - free and open source software scalable network filesystem.
LINBIT - create, remove, and replicate block storage devices for datacenter scale environments.
XtreemFS - fault-tolerant distributed file system for all storage needs.

Applications Platforms

Applications management platforms, Containers management.

Openshift - the Kubernetes platform for big ideas.
Dokku - helps you build and manage the lifecycle of applications.
Flynn - open source platform (PaaS) for running applications in production.
Docker - create, deploy, and run applications by using containers.
Docker Compose - define and run multi-container applications with Docker.
Docker Swarm - Docker-native clustering system.
Kubernetes - automating deployment, scaling, and management of containerized applications.
LXC - lets Linux users easily create and manage system or application containers.
Rancher - lets you deliver Kubernetes-as-a-Service.
OpenVz - container-based virtualization for Linux.
Singularity - run the application from the local environment to the cloud.
AppScale - easy-to-manage serverless platform for building and running scalable web and mobile applications.
Kata Containers - building lightweight virtual machines that seamlessly plug into the containers ecosystem.

Container Image Registry

Container Image registry.

Quay - container image registry that enables you to build, organize, distribute, and deploy containers.
Dockyard - Container & Artifact Repository.

Automation & Orchestration

Tools for automation, orchestration, deployment, provisioning and configuration management.

Ansible - simple IT automation platform that makes your applications and systems easier to deploy.
Salt - automate the management and configuration of any infrastructure or application at scale.
Puppet - unparalleled infrastructure automation and delivery.
Chef - automate infrastructure and applications.
Juju - simplifies how you configure, scale and operate todays complex software.
Rundeck - Runbook Automation For Modernizing Your Operations.
StackStorm - connects all your apps, services, and workflows. Automate DevOps your way.
Bosh - release engineering, deployment, and lifecycle management of complex distributed systems.
Cloudify - Connect, Control, & Automate from core to edge: unlimited locations, clouds and devices.
Tsuru - an extensible and open source Platform as a Service software.
Fabric - high level Python library designed to execute shell commands remotely over SSH.
Capistrano - A remote server automation and deployment tool.
Mina - really fast deployer and server automation tool.
Terraform - use Infrastructure as Code to provision and manage any cloud, infrastructure, or service.
Packer - build Automated Machine Images.
Vagrant - Development Environments Made Easy.
Foreman - complete lifecycle management tool for physical and virtual servers.
Nomad - deploy and Manage Any Containerized, Legacy, or Batch Application.
Marathon - a production-grade container orchestration platform for DC/OS and Apache Mesos.
Atlantis - Terraform Pull Request Automation.
OctoDNS - managing DNS across multiple providers. DNS as code.

Continuous Integration & Delivery

Continuous Integration, Continuous Delivery and Continuous Delivery.

On premises
- Buildbot - automate all aspects of the software development cycle.
- Gitlab CI - pipelines build, test, deploy, and monitor your code as part of a single, integrated workflow.
- Jenkins - automation server for building, deploying and automating any project.
- Drone - a Container-Native, Continuous Delivery Platform.
- Concourse - pipeline-based continuous thing-doer.
- Spinnaker - fast, safe, repeatable deployments for every Enterprise.
- goCD - Delivery and Release Automation server.
- Teamcity - enterprise-level CI and CD.
- Bamboo - tie automated builds, tests, and releases together in a single workflow.
- Integrity - Continuous Integration server.
- Zuul - drives continuous integration, delivery, and deployment systems with a focus on project gating.
- Argo - open source Kubernetes native workflows, events, CI and CD.
- Strider - Continuous Deployment/Continuous Integration platform.
Web service
- Travis CI - easily sync your projects, you’ll be testing your code in minutes.
- Circle CI - powerful CI/CD pipelines that keep code moving.
- Bitrise - CI/CD for mobile applications.
- Buildkite - run fast, secure, and scalable continuous integration pipelines on your own infrastructure.
- Cirrus CI - cycle fast, efficient, and secure with modern cloud technologies.

Source Code Management

Source Code management, Git-repository manager, Version Control. Some of them include Code review.

Github - helps developers store and manage their code, as well as track and control changes to their code.
Gitlab - entire DevOps lifecycle in one application.
Bitbucket - gives teams one place to plan projects, collaborate on code, test, and deploy
Phabricator - a collection of web applications which help software companies build better software.
Gogs - a painless self-hosted Git service.
Gitea - a painless self-hosted Git service.
Gitblit - pure Java Git solution for managing, viewing, and serving Git repositories.

Web Servers

Web servers and reverse proxy.

Nginx - high performant load balancer, web server and reverse proxy.
Apache - web server and reverse proxy.
Caddy - web server with automatic HTTPS.
Cherokee - highly concurrent secured web applications.
Lighttpd - optimized for speed-critical environments while remaining standards-compliant, secure and flexible.
Uwsgi - application server container.

SSL

Tools for automate the management of SSL certificates.

Certbot - automatically using Let’s Encrypt certificates on manually-administrated websites to enable HTTPS.
Let’s Encrypt - free, automated, and open Certificate Authority.
Cert Manager - K8S add-on to automate the management and issuance of TLS certificates from various issuing sources.

Databases

Rational (SQL) and non-rational (NO-SQL) databases.

Rational (SQL)
- PostgreSQL - powerful, open source object-relational database system.
- MySQL - open-source relational database management system.
- MariaDB - fast, scalable and robust, with a rich ecosystem of storage engines, plugins and many other tools.
- SQLite - small, fast, self-contained, high-reliability, full-featured, SQL database engine.
Non-relational (No-SQL)
- Casandra - manage massive amounts of data, fast, without losing sleep.
- Apache HBase - distributed, versioned, non-relational database.
- Couchdb - database that completely embraces the web.
- Elasticsearch - distributed, RESTful search and analytics engine capable of addressing a growing number of use cases.
- MongoDB - general purpose, document-based, distributed database built for modern application.
- Rethinkdb - open-source database for the realtime web.
- Key-Value
  - Couchbase - distributed multi-model NoSQL document-oriented database that is optimized for interactive applications.
  - Leveldb - fast key-value storage library.
  - Redis - in-memory data structure store, used as a database, cache and message broker.
  - RocksDB - a library that provides an embeddable, persistent key-value store for fast storage.
  - Etcd - distributed reliable key-value store for the most critical data of a distributed system.

Observability & Monitoring

Observability, Monitoring, Metrics/Metrics collection and Alerting tools.

Sensu - Simple. Scalable. Multi-cloud monitoring.
Alerta - scalable, minimal configuration and visualization monitoring system.
Cabot - self-hosted, easily-deployable monitoring and alerts service.
Amon - modern server monitoring platform.
Flapjack - monitoring notification routing + event processing system.
Icinga - monitors availability and performance, gives you simple access to relevant data and raises alerts.
Monit - managing and monitoring Unix systems.
Naemon - fast, stable and innovative while giving you a clear view of the state of your network and applications.
Nagios - computer-software application that monitors systems, networks and infrastructure.
Sentry - error monitoring that helps all software teams discover, triage, and prioritize errors in real-time.
Shinken - monitoring framework.
Zabbix - mature and effortless monitoring solution for network monitoring and application monitoring.
Glances - monitoring information through a curses or Web based interface.
Healthchecks - cron monitoring tool.
Bolo - building distributed, scalable monitoring systems.
cAdvisor - analyzes resource usage and performance characteristics of running containers.
ElastiFlow - network flow monitoring (Netflow, sFlow and IPFIX) with the Elastic Stack.
Co-Pilot - system performance analysis toolkit.
Metrics/Metrics collection
- Prometheus - power your metrics and alerting with a leading open-source monitoring solution.
- Collectd - the system statistics collection daemon.
- Facette - time series data visualization software.
- Grafana - analytics & monitoring solution for every database.
- Graphite - store numeric time-series data and render graphs of this data on demand.
- Influxdata - time series database.
- Netdata - instantly diagnose slowdowns and anomalies in your infrastructure.
- Freeboard - real-time dashboard builder for IOT and other web mashups.
Logs Management
- Anthracite - an event/change logging/managament app.
- Graylog - free and open source log management.
- Logstash - collect, parse, transform logs.
- Fluentd - data collector for unified logging layer.
- Flume - distributed, reliable, and available service for efficiently collecting, aggregating, and moving logs.
- Heka - stream processing software system.
- Kibana - explore, visualize, discover data.
Status
- Cachet - beautiful and powerful open source status page system.

Service Discovery & Service Mesh

Service Discovery, Service Mesh and Failure detection tools.

Consul - connect and secure any service.
Serf - decentralized cluster membership, failure detection, and orchestration.
Doozerd - a consistent distributed data store.
Zookeeper - centralized service for configuration, naming, providing distributed synchronization, and more.
Etcd - distributed, reliable key-value store for the most critical data of a distributed system.
Istio - connect, secure, control, and observe services.
Kong - deliver performance needed for microservices, service mesh, and cloud native deployments.
Linkerd - service mesh for Kubernetes and beyond.

API Gateway

API Gateway, Service Proxy and Service Management tools.

API Umbrella - proxy that sits in front of your APIs.
Ambassador - Kubernetes-Native API Gateway built on the Envoy Proxy.
Kong - connect all your microservices and APIs with the industry’s most performant, scalable and flexible API platform.
Tyk - API and service management platform.
Cilium - API aware networking and security using BPF and XDP.
Gloo - feature-rich, Kubernetes-native ingress controller, and next-generation API gateway.
Envoy - cloud-native high-performance edge/middle/service proxy.
Traefik - reverse proxy and load balancer for HTTP and TCP-based applications.
Nginx - high performant reverse proxy.

Code review

Code review. In Source Code Management section you can find few of them with Code review already as feature.

Gerrit - web-based team code collaboration tool.
Review Board - web-based collaborative code review tool.

Distributed messaging

Distributed messaging platforms and Queues software.

Rabbitmq - message broker.
Kafka - building real-time data pipelines and streaming apps.
Activemq - Multi-Protocol messaging.
Beanstalkd - simple, fast work queue.
NSQ - realtime distributed messaging platform.
Celery - asynchronous task queue/job queue based on distributed message passing.
Faktory - repository for background jobs within your application.
Nats - simple, secure and high performance open source messaging system.
RestMQ - message queue which uses HTTP as transport.
Dkron - distributed, fault tolerant job scheduling system.

Programming Languages

Programming languages.

Pyhon - programming language that lets you work quickly and integrate systems more effectively.
Ruby - a dynamic, open source programming language with a focus on simplicity and productivity.
Go - an open source programming language that makes it easy to build simple, reliable, and efficient software.

Chat and ChatOps

Chat and ChatOps.

Rocket - open source team communication.
Mattermost - messaging platform that enables secure team collaboration.
Zulip - real-time chat with an email threading model.
Riot - a universal secure chat app entirely under your control.
ChatOps:
- CloudBot - simple, fast, expandable, open-source Python IRC Bot.
- Hubot - a customizable life embetterment robot.
- Lita - a robot companion for your company's chat room.

Secret Management

Security as code, sensitive credentials and secrets need to be managed, security, maintained and rotated using automation.

Sops - simple and flexible tool for managing secrets.
Vault - manage secrets and protect sensitive data.
Keybase - end-to-end encrypted chat and cloud storage system.

A collection of tools to help with sharing knowledge and telling the story.

Gitbook - modern documentation format and toolchain using Git and Markdown.
Docusaurus - easy to maintain open source documentation websites.
Docsify - a magical documentation site generator.
MkDocs - project documentation with Markdown.

VPN

VPN, routing and firewall.

OpenVPN - flexible VPN solutions to secure your data communications, whether it's for Internet privacy,
Pritunl - enterprise Distributed OpenVPN and IPsec Server.
VyOS - open source network OS that runs on a wide range of hardware, virtual machines, and cloud providers.
Algo - set up a personal VPN in the cloud.
Streisand - sets up a new VPN services nearly automatically.
Freelan - a peer-to-peer, secure, easy-to-setup, multi-platform, open-source, highly-configurable VPN software.
Sshuttle - transparent proxy server that works as a poor man's VPN.

Resources

Books

Books focused on DevOps, DevSecOps and Site Reliability Engineering.

Conferences

Contributing

Your contributions are always welcome! Please take a look at the Contribution Guidelines.

Authors

Created by DevOps for DevOps.

25 KiB Raw Blame History Unescape Escape