ES详解 - 资料：Awesome Elasticsearch
大约 14 分钟
ES详解 - 资料：Awesome Elasticsearch
本文来自 GitHub Awesome Elasticsearch 项目在新窗口打开, 搜集ElasticSearch相关的优秀资料。
General
Elastic Stack
- Elasticsearch在新窗口打开 official website
- Logstash在新窗口打开 is a data pipeline that helps you process logs and other event data from a variety of systems
- Kibana在新窗口打开 is a data analysis tool that helps to visualize your data; Kibana Manual docs在新窗口打开
- beats在新窗口打开 is the platform for building lightweight, open source data shippers for many types of data you want to enrich with Logstash, search and analyze in Elasticsearch, and visualize in Kibana.
Books
- Deep Learning for Search在新窗口打开 - teaches you how to leverage neural networks, NLP, and deep learning techniques to improve search performance. (2019)
- Relevant Search: with applications for Solr and Elasticsearch在新窗口打开 - demystifies relevance work. Using Elasticsearch, it teaches you how to return engaging search results to your users, helping you understand and leverage the internals of Lucene-based search engines. (2016)
- Elasticsearch in Action在新窗口打开 - teaches you how to build scalable search applications using Elasticsearch (2015)
lists
- frutik/awesome-search在新窗口打开 I am building e-commerce search now. Below are listed some of my build blocks
Open-source and free products, based on Elasticsearch
- Fess在新窗口打开 is an open source full featured Enterprise Search, with a web-crawler
- Yelp/elastalert在新窗口打开 is a modular flexible rules based alerting system written in Python
- etsy/411在新窗口打开 - an Alert Management Web Application https://demo.fouroneone.io (credentials: user/user)
- appbaseio/mirage在新窗口打开 is a 🔎 GUI for composing Elasticsearch queries
- exceptionless/Exceptionless在新窗口打开 is an error (exceptions) collecting and reporting server with client bindings for a various programming languages
- searchkit/searchkit在新窗口打开 is a UI framework based on React to build awesome search experiences with Elasticsearch
- appbaseio/reactivemaps在新窗口打开 is a React based UI components library for building Airbnb / Foursquare like Maps
- appbaseio/reactivesearch在新窗口打开 is a library of beautiful React UI components for Elasticsearch
- appbaseio/dejavu在新窗口打开 The missing UI for Elasticsearch; landing page在新窗口打开
- Simple File Server在新窗口打开 is an Openstack Swift compatible distributed object store that can serve and securely store billions of large and small files using minimal resources.
- logagent在新窗口打开 a log shipper to parse and ship logs to Elasticsearch including bulk indexing, disk buffers and log format detection.
- ItemsAPI在新窗口打开 simplified search API for web and mobile (based on Elasticsearch and Express.js)
- Kuzzle在新窗口打开 - An open-source backend with advanced real-time features for Web, Mobile and IoT that uses ElasticSearch as a database. (Website在新窗口打开)
- SIAC在新窗口打开 - SIAC is an enterprise SIEM built on the ELK stack and other open-source components.
- Sentinl在新窗口打开 - Sentinl is a Kibana alerting and reporting app.
- Praeco在新窗口打开 - Elasticsearch alerting made simple
Elasticsearch developer tools and utilities
Development and debugging
- Sense (from Elastic)在新窗口打开 A JSON aware developer console to Elasticsearch; official and very powerful
- ES-mode在新窗口打开 An Emacs major mode for interacting with Elasticsearch (similar to Sense)
- Elasticsearch Cheatsheet在新窗口打开 Examples for the most used queries, API and settings for all major version of Elasticsearch
- Elasticstat在新窗口打开 CLI tool displaying monitoring informations like htop
- Elastic for Visual Studio Code在新窗口打开 An extension for developing Elasticsearch queries like Kibana and Sense extention in Visual Studio Code
- Elastic Builder在新窗口打开 A Node.js implementation of the Elasticsearch DSL
- Bodybuilder在新窗口打开 A Node.js elasticsearch query body builder
- enju在新窗口打开 A Node.js elasticsearch ORM
- Peek在新窗口打开 An interactive CLI in Python that works like Kibana Console with additional features
Import and Export
- Knapsack plugin在新窗口打开 is an "swiss knife" export/import plugin for Elasticsearch
- Elasticsearch-Exporter在新窗口打开 is a command line script to import/export data from Elasticsearch to various other storage systems
- esbulk在新窗口打开 Parallel elasticsearch bulk indexing utility for the command line.
- elasticdump在新窗口打开 - tools for moving and saving indices
- elasticsearch-loader在新窗口打开 - Tool for loading common file types to elasticsearch including csv, json, and parquet
Management
- Esctl在新窗口打开 - High-level command line interface to manage Elasticsearch clusters.
- Vulcanizer在新窗口打开 - Github's open sourced cluster management library based on Elasticsearch's REST API. Comes with a high level CLI tool
Elasticsearch plugins
Cluster
- sscarduzio/elasticsearch-readonlyrest-plugin在新窗口打开 Safely expose Elasticsearch REST API directly to the public
- mobz/elasticsearch-head在新窗口打开 is a powerful and essential plugin for managing your cluster, indices and mapping
- Bigdesk在新窗口打开 - Live charts and statistics for elasticsearch cluster
- Elastic HQ在新窗口打开 - Elasticsearch cluster management console with live monitoring and beautiful UI
- Cerebro在新窗口打开 is an open source(MIT License) elasticsearch web admin tool. Supports ES 5.x
- Kopf在新窗口打开 - Another management plugin that have REST console and manual shard allocation
- Search Guard在新窗口打开 - Elasticsearch and elastic stack security and alerting for free
- ee-outliers在新窗口打开 - ee-outliers is a framework to detect outliers in events stored in an Elasticsearch cluster.
- Elasticsearch Comrade在新窗口打开 - Elasticsearch admin panel built for ops and monitoring
- elasticsearch-admin在新窗口打开 - Web administration for Elasticsearch
Other
- SIREn Join Plugin for Elasticsearch在新窗口打开 This plugin extends Elasticsearch with new search actions and a filter query parser that enables to perform a "Filter Join" between two set of documents (in the same index or in different indexes).
Integrations and SQL support
- NLPchina/elasticsearch-sql在新窗口打开 - Query elasticsearch using familiar SQL syntax. You can also use ES functions in SQL.
- elastic/elasticsearch-hadoop在新窗口打开 - Elasticsearch real-time search and analytics natively integrated with Hadoop (and Hive)
- jprante/elasticsearch-jdbc在新窗口打开 - JDBC importer for Elasticsearch
- pandasticsearch在新窗口打开 - An Elasticsearch client exposing DataFrame API
- monstache在新窗口打开 - Go daemon that syncs MongoDB to Elasticsearch in near realtime
You know, for search
- jprante/elasticsearch-plugin-bundle在新窗口打开 A plugin that consists of a compilation of useful Elasticsearch plugins related to indexing and searching documents
Kibana plugins and applications
- elastic/timelion在新窗口打开 time-series analyses application. Overview and installation guide: Timelion: The time series composer for Kibana在新窗口打开
- Kibana Alert App for Elasticsearch在新窗口打开 - Kibana plugin with monitoring, alerting and reporting capabilities
- VulnWhisperer在新窗口打开 - VulnWhisperer is a vulnerability data and report aggregator.
- Wazuh Kibana App在新窗口打开 - A Kibana app for working with data generated by Wazuh在新窗口打开.
- Datasweet Formula在新窗口打开 - A real time calculated metric plugin Datasweet Formula在新窗口打开.
Kibana Visualization plugins
- nbs-system/mapster在新窗口打开 - a visualization which allows to create live event 3d maps in Kibana
- Kibana Tag Cloud Plugin在新窗口打开 - tag cloud visualization plugin based on d3-cloud plugin
- LogTrail在新窗口打开 - a plugin for Kibana to view, analyze, search and tail log events from multiple hosts in realtime with devops friendly interface inspired by Papertrail
- Analyze API在新窗口打开 - Kibana 6 application to manipulate the
_analyzeAPI graphically - kbn_network在新窗口打开 - This is a plugin developed for Kibana that displays a network node that link two fields that have been previously selected.
Discussions and social media
- /r/elasticsearch在新窗口打开
- Elasticsearch forum在新窗口打开
- Stackoverflow在新窗口打开
- Books on Amazon在新窗口打开 does not fit well into this category, but worth checking out!
- TODO: Put some good twitter accounts
Tutorials
- Centralized Logging with Logstash and Kibana On Ubuntu 14.04在新窗口打开 everything you need to now when you are creating your first Elasticsearch+Logstash+Kibana instance
- dwyl/learn-elasticsearch在新窗口打开 a getting started tutorial with a pack of valuable references
- Make Sense of your Logs: From Zero to Hero in less than an Hour! by Britta Weber在新窗口打开 demonstrates how you can build Elasticsearch + Logstash + Kibana stack to collect and discover your data
- $$ Elasticsearch 7 and Elastic Stack在新窗口打开 - liveVideo course that teaches you to search, analyze, and visualize big data on a cluster with Elasticsearch, Logstash, Beats, Kibana, and more.
Articles
System configuration
- A Useful Elasticsearch Cheat Sheet in Times of Trouble在新窗口打开
- The definitive guide for Elasticsearch on Windows Azure在新窗口打开
- Elasticsearch pre-flight checklist在新窗口打开
- 9 Tips on Elasticsearch Configuration for High Performance在新窗口打开
- Best Practices in AWS在新窗口打开
- How to Secure Elasticsearch and Kibana在新窗口打开 with NGINX, LDAP and SSL 🔒
- Elasticsearch server on Webfaction using NGINX with basic authorization and HTTPS protocol在新窗口打开
- Elasticsearch Guides在新窗口打开 Useful Elasticsearch guides with best practices, troubleshooting instructions for errors, tips, examples of code snippets and more.
Docker and Elasticsearch
Java tuning
- Elasticsearch Java Virtual Machine settings explained在新窗口打开
- Tuning Garbage Collection for Mission-Critical Java Applications在新窗口打开
- G1: One Garbage Collector To Rule Them All在新窗口打开
- Use Lucene’s MMapDirectory on 64bit platforms, please!在新窗口打开
- Black Magic cookbook在新窗口打开
- G1GC Fundamentals: Lessons from Taming Garbage Collection在新窗口打开
- JVM Garbage Collector settings investigation在新窗口打开 PDF Comparison of JVM GC
- Garbage Collection Settings for Elasticsearch Master Nodes在新窗口打开 Fine tunine your garbage collector
- Understanding G1 GC Log Format在新窗口打开 To tune and troubleshoot G1 GC enabled JVMs, one must have a proper understanding of G1 GC log format. This article walks through key things that one should know about the G1 GC log format.
How to start using G1
#ES_JAVA_OPTS=""
ES_JAVA_OPTS="-XX:-UseParNewGC -XX:-UseConcMarkSweepGC -XX:+UseG1GC"
Scalable Infrastructure and performance
- The Authoritative Guide to Elasticsearch Performance Tuning (Part 1)在新窗口打开 Part 2在新窗口打开 Part 3在新窗口打开
- Tuning data ingestion performance for Elasticsearch on Azure在新窗口打开 - and not only for Azure. That's a great article about Elasticsearch Performance testing by example
- Elasticsearch Indexing Performance Cheatsheet在新窗口打开 - when you plan to index large amounts of data in Elasticsearch (by Patrick Peschlow)
- Elasticsearch for Logging在新窗口打开 Elasticsearch configuration tips and tricks from Sanity
- Scaling Elasticsearch to Hundreds of Developers在新窗口打开 by Joseph Lynch @yelp
- 10 Elasticsearch metrics to watch在新窗口打开
- Understanding Elasticsearch Performance在新窗口打开
- Our Experience of Creating Large Scale Log Search System Using Elasticsearch在新窗口打开 - topology, separate master, data and search balancers nodes
- 📂 Elasticsearch on Azure Guidance在新窗口打开 it is 10% on Azure and 90% of a very valuable general information, tips and tricks about Elasticsearch
- How to avoid the split-brain problem in Elasticsearch在新窗口打开
- Datadog's series about monitoring Elasticsearch performance:
- Performance Monitoring Essentials - Elasticsearch Edition在新窗口打开
- Operator for running Elasticsearch in Kubernetes在新窗口打开
Integrations
- Apache Hive integration在新窗口打开
- Connecting Tableau to Elasticsearch (READ: How to query Elasticsearch with Hive SQL and Hadoop)在新窗口打开
- mradamlacey/elasticsearch-tableau-connector在新窗口打开
Logging
- 5 Logstash Alternatives在新窗口打开 and typical use cases
Alerts
- ElastAlert: Alerting At Scale With Elasticsearch, Part 1在新窗口打开 by engineeringblog.yelp.com
- ElastAlert: Alerting At Scale With Elasticsearch, Part 2在新窗口打开 by engineeringblog.yelp.com
- Elastalert: implementing rich monitoring with Elasticsearch在新窗口打开
Time series
- Elasticsearch as a Time Series Data Store在新窗口打开 by Felix Barnsteiner
- Running derivatives on Voyager velocity data在新窗口打开 By Colin Goodheart-Smithe
- Shewhart Control Charts via Moving Averages: Part 1在新窗口打开 - Part 2在新窗口打开 by Zachary Tong
- Implementing a Statistical Anomaly Detector: Part 1在新窗口打开 - Part 2在新窗口打开 - Part 3在新窗口打开 by Zachary Tong
Machine Learning
- Classifying images into Elasticsearch with DeepDetect在新窗口打开 (forum thread with discussion在新窗口打开) by Emmanuel Benazera
- Elasticsearch with Machine Learning在新窗口打开 (English translation在新窗口打开) by Kunihiko Kido
- Recommender System with Mahout and Elasticsearch在新窗口打开
Use cases for Elasticsearch
- Data Infrastructure at IFTTT在新窗口打开 Elasticsearch, Kafka, Apache Spark, Redhsift, other AWS services
- OFAC compliance with Elasticsearch在新窗口打开 using AWS
- Building a Streaming Search Platform在新窗口打开 - Streaming Search on Tweets: Storm, Elasticsearch, and Redis
Other
- LogZoom, a fast and lightweight substitute for Logstash在新窗口打开
- Graylog2/graylog2-server在新窗口打开 - Free and open source log management (based on ES)
- Fluentd vs. Logstash for OpenStack Log Management在新窗口打开
- Building a Directory Map With ELK在新窗口打开
- Structured logging with ELK - part 1在新窗口打开
- Search for 😋 Emoji with Elasticsearch 🔎在新窗口打开
- Complete Guide to the ELK Stack在新窗口打开
- logiq在新窗口打开 - Simple WebUI Monitoring Tool for Logstash ver. 5.0 and up
- ElasticSearch Report Engine在新窗口打开 - An ElasticSearch plugin to return query results as either PDF,HTML or CSV.
- Elasticsearch Glossary在新窗口打开 - explanations of Elasticsearch terminology, including examples, common best practices and troubleshooting guides for various issues.
Videos
Overviews
- Elasticsearch for logs and metrics: A deep dive – Velocity 2016在新窗口打开 by Sematext Developers
- Elasticsearch in action Thijs Feryn在新窗口打开 a beginner overview
- Getting Down and Dirty with ElasticSearch by Clinton Gormley 在新窗口打开
- How we scaled Raygun在新窗口打开
- Getting started with Elasticsearch在新窗口打开
- Speed is a Key: Elasticsearch under the Hood在新窗口打开 introduction + basic performance optimization
- $$ Pluralsight: Getting Started With Elasticsearch for .NET Developers在新窗口打开 this course will introduce users to Elasticsearch, how it works, and how to use it with .NET projects.
- $$ Complete Guide to Elasticsearch在新窗口打开 Comprehensive guide to Elasticsearch, the popular search engine built on Apache Lucene
- How Elasticsearch powers the Guardian's newsroom在新窗口打开
- Elasticsearch Query Editor in Grafana在新窗口打开
- Scale Your Metrics with Elasticsearch在新窗口打开 2019 by Philipp Krenn (Elastic) optimization tips and tricks
Advanced
- #bbuzz 2015: Adrien Grand – Algorithms and data-structures that power Lucene and Elasticsearch在新窗口打开
- Rafał Kuć - Running High Performance Fault-tolerant Elasticsearch Clusters on Docker在新窗口打开 and slides在新窗口打开
- Working with Elasticsearch - Search, Aggregate, Analyze, and Scale Large Volume Datastores在新窗口打开 - O'Reilly Media
- End-to-end Recommender System with Spark and Elasticsearch在新窗口打开 by Nick Pentreath & Jean-François Puget. Slide deck在新窗口打开
Code, configuration file samples and other gists
- Elasticsearch config for a write-heavy cluster在新窗口打开 - reyjrar/elasticsearch.yml
- chenryn/ESPL - Elastic Search Processing Language在新窗口打开 PEG parser sample for SPL to Elasticsearch DSL
- thomaspatzke/EQUEL在新窗口打开 an Elasticsearch QUEry Language, based on G4 grammar parser
Who is using elasticsearch?
Yelp在新窗口打开, IFTTT在新窗口打开, StackExchange在新窗口打开, Raygun在新窗口打开, Mozilla在新窗口打开, Spotify在新窗口打开, CERN在新窗口打开, NASA在新窗口打开Zalando在新窗口打开
I want more! (Elasticsearch related resources)
Contributing
- Make sure you are about to post a valuable resource that belongs to this list
- Do NOT group ++Add and --Remove changes in same PR. Make them separate pull requests
- Use spellchecker
- All spelling and grammar corrections are welcome (except for the rule above)
- Fork this repo, do your edits, send the pull request
- Feel free to create any new sections
- Do not even try to add this repo to any awesome-awesome-* lists