Table of Contents


Top

Middleware

Index of Middleware



What is Middleware

Middleware

Middleware is computer software that provides services to software applications beyond those available from the operating system.
Middleware is the software layer that lies between the operating system and the applications on each side of a distributed computer network.
Middleware includes Web servers, application servers, content management systems, and similar tools that support application development and delivery.




Note



I tagged. LOVE LIKE BETTERCHECK

Infrastracture as code(IaC) / Automation

Infrastructure as Code

Infrastructure as code (IaC) is the process of managing and provisioning computer data centers through machine-readable definition files, rather than physical hardware configuration or interactive configuration tools.

Infrastracture as code(IaC)

Middleware Note
Terraform Write, Plan, and Create Infrastructure as Code

Configuration Management

Middleware Note
Chef http://www.getchef.com/ Chef (software)
Chef delivers fast, scalable, flexible IT automation.
Customers : facebook
Puppet http://puppetlabs.com/ Puppet (software)
Puppet Enterprise : manage 10 nodes free
Users : PayPal, GitHub, twitter, redhat, salesforce, at&t, London Stock Exchange
Ansible popular http://www.ansible.com/ Ansible (software)
http://docs.ansible.com/
Users : EVERNOTE, juniper, rackspace, NASA, VeriSign, Twitter, Atlassian
AWX
Itamae

Deployment tool / Orchestration

Middleware Note
Capistrano http://capistranorb.com/ Capistrano (software)
A remote server automation and deployment tool written in Ruby.
Fabric
LOVE
http://www.fabfile.org/
Fabric is a Python library and command-line tool for streamlining the use of SSH for application deployment or systems administration tasks.
Netmiko https://github.com/ktbyers/netmiko

Automated OS Install / Bootstrapping

Middleware Note
Packer https://packer.io/
cloud-init https://launchpad.net/cloud-init
https://cloudinit.readthedocs.io/en/latest/
Cobbler http://www.cobblerd.org/
Cobbler is a Linux installation server that allows for rapid setup of network installation environments.
koan
FAI
Fully Automatic Installation
http://fai-project.org/

Configuration Test

Middleware Note
Serverspec http://serverspec.org/
tests for checking your servers
Infrataster https://github.com/ryotarai/infrataster


Virtualization

Hypervisor

Hypervisor

Virtual Machine Manager(virt-manager) http://virt-manager.org/

virtual development tool

Container

Middleware Note
Docker popular https://www.docker.com/ Since 2013
Docker Compose
Nomad
LXC
LOVE
Since 2008
(Linux Containers)
LXD
LOVE
Since 2015
(Linux Container Daemon)
systemd-nspawn
rkt
OpenVZ Since 2005

cloud computing platform

Middleware Note
OpenStack http://www.openstack.org/ OpenStack
ClaudStack
Eucalyptus


Monitoring

Resource Monitoring

Middleware Note
Zabbix popular http://www.zabbix.com/ Zabbix
https://www.zabbix.com/documentation/start
Nagios http://www.nagios.org/ Nagios
Yahoo!, AOL, McAfee, at&t
Sensu CHECK https://sensuapp.org/
Prometheus CHECK https://prometheus.io/
Prometheus+ Grafana
Cacti http://www.cacti.net/ Cacti (software)
Ganglia http://www.ganglia.info/ Ganglia (software)
Twitter, Flickr, Wikipedia, Bank of America, HP, Cisco, Microsoft
Munin
STOR2RRD LIKE http://www.stor2rrd.com/
Real-time storage and SAN performance visibility in multi-vendor environment
XP7, 3PAR, NetApp, EMC VMX etc

Data Store

Middleware Note
Grafana Loki
Elasticsearch popular https://www.elastic.co/
fluedntd → elasticsearch → kibana
Graphite
LIKE
http://graphiteapp.org/
Make it easy to store and graph metrics.
Graphite → Grafana
InfluxDB https://www.influxdata.com/
Purpose Built Time Series Database

ELK Stack (Elasticsearch、Logstash、Kibana)
EFK Stack (Elasticsearch、fluentd、Kibana)

Dashboard

Middleware Note
Kibana https://www.elastic.co/guide/en/kibana/current/index.html
https://github.com/elastic/kibana
Kibana is an open source (Apache Licensed), browser based analytics and search dashboard for Elasticsearch.
fluedntd → elasticsearch → kibana
Grafana
LIKE
The open platform for beautiful analytics and monitoring
https://grafana.com/
Graphite or InfluxDB or Elasticsearch or CloudWatch etc → Grafana
Grafana is simple and easy to use.
Prometheus + Grafana

Log

Middleware Note
Beats https://www.elastic.co/
Filebeat (Log Files : Apache, Nginx, Auditd, MySQL)
Metricbeat (Metrics : CPU,memory,Apache,NGINX etc)
Packetbeat (Network Data)
Winlogbeat (Windows Event Logs)
Heartbeat (Uptime Monitoring)
fluentd popular http://www.fluentd.org/
Users : amazon web services, slideshare, LINE, Nintendo, GREE
fluedntd → elasticsearch → kibana
osquery https://osquery.io/
Graylog popular https://www.graylog.org/
Logstash http://logstash.net/
Swatch http://sourceforge.net/projects/swatch/
Splunk http://www.splunk.com/
Piwik https://piwik.org/
Piwik is the leading open-source analytics platform

ELK Stack (Elasticsearch、Logstash、Kibana)
EFK Stack (Elasticsearch、fluentd、Kibana)


Web Server

Web server

Middleware Note
Apache HTTP Server http://httpd.apache.org/ Apache HTTP Server
Apache httpd has been the most popular web server on the Internet .
Nginx http://nginx.com/ Nginx
The world's busiest websites use NGINX.
NGINX powers almost 30% of the top 100,000 busiest sites and over 15% of all web sites on the Internet.
Users : hulu, facebook, dropbox, NETFLIX
LiteSpeed


Proxy Server

Proxy server

Middleware Note
Squid http://www.squid-cache.org/
Optimising Web Delivery
DeleGate http://delegate.hpcc.jp/delegate/
http://www.delegate.org/delegate/
Varnish Cache https://www.varnish-cache.org/
Varnish Cache is a web application accelerator also known as a caching HTTP reverse proxy.
Apache Traffic Server Apache Traffic Server software is a fast, scalable and extensible HTTP/1.1 compliant caching proxy server.
http://trafficserver.apache.org/


Mail Server

MTA (mail transfer agent)

IMAP and POP3 server

Middleware Note
Dovecot (pop3, imap) http://dovecot.org/ Dovecot (software)
qpopper (pop3) Qpopper
qmail-pop3d (pop3)
Courier-IMAP (imap)
UW-IMAP (imap)
Cyrus IMAP (imap)

MLM (mailing list management software)

Middleware Note
Sympa http://www.sympa.org
Sympa is an open source mailing list manager. It provides advanced features with a rich and secure web interface.
Mailman https://www.gnu.org/software/mailman/ GNU Mailman
ezmlm ezmlm


Name Server (DNS Server)

I want to use Auto serial.

Middleware Note
Bind http://www.isc.org/downloads/bind/
NSD
BETTER
https://www.nlnetlabs.nl/projects/nsd/
NSD is an authoritative only, high performance, simple and open source name server.
Unbound
BETTER
https://unbound.net/
Unbound is a validating, recursive, and caching DNS resolver.
Users : IIJ
knot DNS
PowerDNS
LIKE
https://www.powerdns.com/ PowerDNS
Users : Wikipedia, MyDNS.jp
djbdns tinydns : DNS Server
axfrdns
axfr-get
dnscache
Users : Facebook
Microsoft DNS Microsoft DNS
MyDNS http://www.mydns-ng.com/
Not maintained – last update was 2010
Users : Mobage


Authentication

Middleware Note
FreeIPA https://www.freeipa.org/
FreeIPA is an integrated security information management solution combining Linux (Fedora), 389 Directory Server, MIT Kerberos, NTP, DNS, Dogtag (Certificate System).
It consists of a web interface and command-line administration tools.
OpenLDAP https://www.openldap.org/
FreeRADIUS https://freeradius.org/


Job scheduler

Job scheduler

Middleware Note
Airflow https://airflow.incubator.apache.org/
JobScheduler https://www.sos-berlin.com/jobscheduler
Hinemos Hinemos
Job Arranger for Zabbix http://job-scheduler.fitechforce.com/
Digdag https://www.digdag.io/
Digdag is a simple tool that helps you to build, run, schedule, and monitor complex pipelines of tasks.
It handles dependency resolution so that tasks run in order or in parallel.
Azkaban
Rundeck


DB Server

RDB(Relational database)

Relational database

Middleware Note
MariaDB https://mariadb.org/ MariaDB
An enhanced, drop-in replacement for MySQL
Red Hat Enterprise Linux (from RHEL 7), Mozilla, Google, Wikimedia Foundation
MariaDB Galera Cluster is a synchronous multi-master cluster for MariaDB.
MySQL http://www.mysql.com/ MySQL
The world's most popular open source database
PostgreSQL http://www.postgresql.org/ PostgreSQL
Oracle Database http://www.oracle.com/
Oracle RAC
SQLite
LIKE
http://www.sqlite.org/

NoSQL / KVS

NoSQL

Middleware Note
Apache HBase http://hbase.apache.org/ Apache HBase
Cassandra http://cassandra.apache.org/ Apache Cassandra
MongoDB http://www.mongodb.org/
Sourceforge, The New York Times, SAP, eBay
Scalaris
Riak
LIKE

In-Memory Database

Middleware Note
Oracle TimesTen TimesTen

In-Memory Data Grid

Middleware Note
Oracle Coherence Oracle Coherence
Oracle Coherence is a proprietary[1] Java-based in-memory data grid designed to improve reliability, scalability and performance compared to traditional relational database management systems.
GemFire
memcached


Storage

Block Storage

Middleware Note
DRBD
LOVE
http://www.drbd.org/ Distributed Replicated Block Device
Distributed Replicated Block Device

Object Storage

Middleware Note
Riak CS


Distributed Virtual Storage

Middleware Note
Ceph http://ceph.com/
Ceph is a distributed object store and file system designed to provide excellent performance, reliability and scalability.
GlusterFS
LOVE
http://www.gluster.org/
GlusterFS is a scalable network filesystem.
XtreemFS


File Server


distributed processing

Middleware Note
Apache Hadoop http://hadoop.apache.org/
Apache Hadoop
Apache Spark http://spark.apache.org/


Networking

Load Balancing

Middleware Note
LVS
(Linux Virtual Server )
http://www.linuxvirtualserver.org/
you can use “Keepalived” for active, standby.
IPVS
(IP Virtual Server)
http://www.linuxvirtualserver.org/software/ipvs.html
IPVS (IP Virtual Server) implements transport-layer load balancing inside the Linux kernel, so called Layer-4 switching.
keepalived http://www.keepalived.org/
Keepalived is a routing software written in C.
HelthCheck, VRRP, Failoer, VIP
HAProxy LIKE http://www.haproxy.org/
The Reliable, High Performance TCP/HTTP Load Balancer


AP Server

Application server

Middleware Note
Tomcat http://tomcat.apache.org/ Apache Tomcat
Jetty WebSocket
JBoss
WildFly http://wildfly.org/ WildFly
WildFly, formerly known as JBoss AS, or simply JBoss, is an application server authored by JBoss
WebLogic Oracle
WebSphere IBM


HA Cluster (High Availability)

Middleware Note
Pacemaker http://clusterlabs.org/
Pacemaker is an Open Source, High Availability resource manager for clusters.
Pacemaker+Heartbeat Ver.3 , Pacemaker+Corosync
RGMANAGER Red Hat cluster suite
High-Availability Add-On
(Red Hat Cluster Suite : RHCS)
RHEL 5 or RHEL 6 use RGMANAGER. But RHEL 7 was adopted pacemaker.
heartbeat http://www.linux-ha.org/wiki/Heartbeat Linux-HA
Corosync http://corosync.github.io/corosync/
keepalived http://www.keepalived.org/
ServiceGuard
MSFC
(Microsoft Failover Cluster)
MSCS(Microsoft Cluster Service) in previous versions
This is Windows Server function.


Application

Revision Control

Middleware Note
Subversion (svn) http://subversion.apache.org/
git http://git-scm.com/
Git (software)
Git is a distributed revision control and source code management (SCM) system.
Companies & Projects Using Git
Google, facebook, Microsoft, twitter, Linux, eclipse
Gittea
GitHub Enterprise https://enterprise.github.com/
Used by PayPal, rackspace, SAP, DeNA
GitBucket
With Subversion, you can have a 1T repository and check out just a small portion of it, The developers don't need full copies,
Git shops typically have many, smaller repositories, while svn shops typically have a single repository, which eases administration, backup, etc.

Subversion 1.8 Released But Will You Still Use Git?
http://tech.slashdot.org/story/13/06/19/1349228/subversion-18-released-but-will-you-still-use-git


Queing

Middleware Note
ActiveMQ http://activemq.apache.org/
Only Java
RabbitMQ


Continuous Integration (CI)


VPN

Middleware Note
pritunl Enterprise Distributed OpenVPN, IPsec and WireGuard Server
WireGuard
OpenVPN


Security

Middleware Note
Tripwire
AIDE Advanced Intrusion Detection Environment
OSSECBETTER real-time alerting


Document

CodiMD


IP Management

Middleware Note
Netbox
RackTables RackTables is a datacenter asset management system
http://racktables.org/
opendcim http://www.opendcim.org/index.html
DEVICE42



References





Top