Elasticsearch 1.x Cluster Installation (VirtualBox)

•

1 recomendación•9,773 vistas

Amir Sedighi

This is a straightforward tutorial for those are going to run a cluster of elasticsearch on their notebooks or PCs.

Datos y análisis

کارگاه پردازش داده توزیع شده
پردیس- شهیدبهشتی
دانشکده علوم و مهندسی کامپیوتر
درس: پایگاه داده توزیع شده
استاد: دکتر هادی طباطبایی
ارائه: ابوالفضل صدیقی
آذر ۱۳۹۳

2
Elasticsearch Cluster Installation
Amir Sedighi
@amirsedighi
http://hexican.com
Dec 2014

3
References
● http://www.elasticsearch.org
● http://www.elasticsearch.org/guide/en/elasticsea
rch/guide/current/index.html

4
Topics
● Assumptions
● First Node
– Java Installation
– Downloading and Extracting Elasticsearch
– Configuration
● Cloning
● Starting ES Cluster
● ES REST API
● ES General Concepts
– Index, Shard, Segment
– Plugins
● River
● CSV
● JDBC
● Feeder
● ES Commands
● ES GUIs
– Cluster Monitoring
– Analytical Search and BI

5
Assumptions
● You already know about Linux.
– http://www.slideshare.net/AmirSedighi/distrinuted-data-
processing-workshop-sbu

6
Installing Java
● $ sudo apt-get install default-jdk

7
Downloading and Extracting
● http://hadoop.apache.org/releases.html
● $ tar -zxvf elasticsearch1.3.2.gz

8
Elasticsearch Configuration
● You would need to modify elasticsearch.yml
and append the following as a minimum
configuration
cluster.name: hexican
name.name: "node1"
node.master: true
node.data: false

9
Elasticsearch configuration
● Minimum ● Rich

11
Cloning
● Clone the first machine and extend your cluster.
– Find the instruction here:
● http://www.slideshare.net/AmirSedighi/distrinuted-data-processing-
workshop-sbu

15
Starting Elasticsearch Cluster
● You can run nodes one by one
– $ elasticsearch-1.3.4/bin/elasticsearch
● You can run all nodes at once using DSH
– $ dsh -M -a – 'elasticsearch-1.3.4/bin/elasticsearch'

19
Shutdown Cluster
$ curl -XPOST 'http://localhost:9200/_cluster/nodes/_all/_shutdown'

Más contenido relacionado

La actualidad más candente

Web scraping with nutch solrMike Frampton

Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)Ontico

LCA 2012: High Availability Sprinthastexo

Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"Fwdays

深入了解Redisiammutex

Understanding blue store, Ceph's new storage backend - Tim Serong, SUSEOpenStack

Guavafbenault

Setting up repositories: Technical Requirements, Repository Software, Metad...Iryna Kuchma

Friends of Solr - Nutch & HDFSSaumitra Srivastav

Get mysql clusterrunning-windowsJoeSg

Guava Overview Part 2 Bucharest JUG #2 Andrei Savu

Hidden gems in Apache Jackrabbit and BloomReach ForgeWoonsan Ko

Caching. api. http 1.1Artjoker Digital

The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...Glenn K. Lockwood

TWJUG 2016 - Mogilefs, 簡約可靠的儲存方案Hua Chu

Mysql clusterJS Lee

Large Scale Crawling with Apache Nutch and Friendslucenerevolution

Hosting huge amount of binaries in JCRWoonsan Ko

MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...ronwarshawsky

Redis for .NET DevelopersYuriy Guts

La actualidad más candente (20)

Web scraping with nutch solr

Ceph BlueStore - новый тип хранилища в Ceph / Максим Воронцов, (Redsys)

LCA 2012: High Availability Sprint

Philipp Krenn "Elasticsearch (R)Evolution — You Know, for Search…"

深入了解Redis

Understanding blue store, Ceph's new storage backend - Tim Serong, SUSE

Guava

Setting up repositories: Technical Requirements, Repository Software, Metad...

Friends of Solr - Nutch & HDFS

Get mysql clusterrunning-windows

Guava Overview Part 2 Bucharest JUG #2

Hidden gems in Apache Jackrabbit and BloomReach Forge

Caching. api. http 1.1

The Proto-Burst Buffer: Experience with the flash-based file system on SDSC's...

TWJUG 2016 - Mogilefs, 簡約可靠的儲存方案

Mysql cluster

Large Scale Crawling with Apache Nutch and Friends

Hosting huge amount of binaries in JCR

MongoDB performance tuning and load testing, NOSQL Now! 2013 Conference prese...

Redis for .NET Developers

Destacado

Big Data and Machine Learning Workshop - Day 7 @ UTACM Amir Sedighi

Dark dataAmir Sedighi

Big Data and Machine Learning Workshop - Day 5 @ UTACMAmir Sedighi

An Introduction to Apache KafkaAmir Sedighi

آشنایی با داده‌های بزرگ و تکنیک‌های برنامه‌سازی برای پردازش داده‌های بزرگAmir Sedighi

Case Studies on Big-Data Processing and Streaming - Iranian Java User GroupAmir Sedighi

Big Data Processing Utilizing Open-source Technologies - May 2015Amir Sedighi

Destacado (7)

Big Data and Machine Learning Workshop - Day 7 @ UTACM

Dark data

Big Data and Machine Learning Workshop - Day 5 @ UTACM

An Introduction to Apache Kafka

آشنایی با داده‌های بزرگ و تکنیک‌های برنامه‌سازی برای پردازش داده‌های بزرگ

Case Studies on Big-Data Processing and Streaming - Iranian Java User Group

Big Data Processing Utilizing Open-source Technologies - May 2015

Similar a Elasticsearch 1.x Cluster Installation (VirtualBox)

Creating Elasticsearch SnapshotsVic Hargrave

Null Bachaav - May 07 Attack Monitoring workshop.Prajal Kulkarni

The elastic stack on dockerSmartWave

Elastic101tutorial Percona Live Europe 2018Alex Cercel

Elastic 101 tutorial - Percona Europe 2018 Antonios Giannopoulos

Clug 2012 March web server optimisationgrooverdan

OpenStack Tokyo Meeup - Gluster Storage DayDan Radez

Building the Enterprise infrastructure with PostgreSQL as the basis for stori...PavelKonotopov

Hdf installing-hdfnmrrsc

Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...Jeremy Eder

ElasticSearch 5.x - New Tricks - 2017-02-08 - Elasticsearch Meetup Alberto Paro

MySQL Webinar 2/4 Performance tuning, hardware, optimisationMark Swarbrick

Script itGiuseppe Maxia

Xap memory xtend-tutorial-2014Shay Hassidim

OpenStack LA meetup Feb 18, 2015Tesora

Attack monitoring using ElasticSearch Logstash and KibanaPrajal Kulkarni

Managing Oracle Enterprise Manager Cloud Control 12c with Oracle ClusterwareLeighton Nelson

My SQL 101Dave Stokes

Caching and tuning fun for high scalabilityWim Godden

Codership's galera cluster installation and quickstart webinar march 2016Sakari Keskitalo

Similar a Elasticsearch 1.x Cluster Installation (VirtualBox) (20)

Creating Elasticsearch Snapshots

Null Bachaav - May 07 Attack Monitoring workshop.

The elastic stack on docker

Elastic101tutorial Percona Live Europe 2018

Elastic 101 tutorial - Percona Europe 2018

Clug 2012 March web server optimisation

OpenStack Tokyo Meeup - Gluster Storage Day

Building the Enterprise infrastructure with PostgreSQL as the basis for stori...

Hdf installing-hdf

Red Hat Summit 2017: Wicked Fast PaaS: Performance Tuning of OpenShift and D...

ElasticSearch 5.x - New Tricks - 2017-02-08 - Elasticsearch Meetup

MySQL Webinar 2/4 Performance tuning, hardware, optimisation

Script it

Xap memory xtend-tutorial-2014

OpenStack LA meetup Feb 18, 2015

Attack monitoring using ElasticSearch Logstash and Kibana

Managing Oracle Enterprise Manager Cloud Control 12c with Oracle Clusterware

My SQL 101

Caching and tuning fun for high scalability

Codership's galera cluster installation and quickstart webinar march 2016

Más de Amir Sedighi

Big Data and Machine Learning Workshop - Day 6 @ UTACMAmir Sedighi

Big Data and Machine Learning Workshop - Day 4 @ UTACM Amir Sedighi

Big Data and Machine Learning Workshop - Day 3 @ UTACMAmir Sedighi

Big Data and Machine Learning Workshop - Day 2 @ UTACMAmir Sedighi

Big Data and Machine Learning Workshop - Day 1 @ UTACMAmir Sedighi

Two Case Studies Big-Data and Machine Learning at Scale Solutions in IranAmir Sedighi

Helio, a Continues Real-Time Fraud Detection and Monitoring SolutionAmir Sedighi

Opensource Frameworks and BigData ProcessingAmir Sedighi

Más de Amir Sedighi (8)

Big Data and Machine Learning Workshop - Day 6 @ UTACM

Big Data and Machine Learning Workshop - Day 4 @ UTACM

Big Data and Machine Learning Workshop - Day 3 @ UTACM

Big Data and Machine Learning Workshop - Day 2 @ UTACM

Big Data and Machine Learning Workshop - Day 1 @ UTACM

Two Case Studies Big-Data and Machine Learning at Scale Solutions in Iran

Helio, a Continues Real-Time Fraud Detection and Monitoring Solution

Opensource Frameworks and BigData Processing

Último

Top Call Girls in Balaghat 9332606886Call Girls Advance Cash On Delivery Ser...kumargunjan9515

Fun all Day Call Girls in Jaipur 9332606886 High Profile Call Girls You Ca...kumargunjan9515

Vadodara 💋 Call Girl 7737669865 Call Girls in Vadodara Escort service book nowgargpaaro

Charbagh + Female Escorts Service in Lucknow | Starting ₹,5K To @25k with A/C...HyderabadDolls

In Riyadh ((+919101817206)) Cytotec kit @ Abortion Pills Saudi Arabiaahmedjiabur940

Jodhpur Park | Call Girls in Kolkata Phone No 8005736733 Elite Escort Service...HyderabadDolls

Top profile Call Girls In Indore [ 7014168258 ] Call Me For Genuine Models We...gajnagarg

Statistics notes ,it includes mean to index numberssuginr1

Kings of Saudi Arabia, information about themeitharjee

Top profile Call Girls In Satna [ 7014168258 ] Call Me For Genuine Models We ...nirzagarg

DATA SUMMIT 24 Building Real-Time Pipelines With FLaNKTimothy Spann

Sonagachi * best call girls in Kolkata | ₹,9500 Pay Cash 8005736733 Free Home...HyderabadDolls

Top profile Call Girls In Hapur [ 7014168258 ] Call Me For Genuine Models We ...nirzagarg

Lecture_2_Deep_Learning_Overview-newone1ranjankumarbehera14

Predicting HDB Resale Prices - Conducting Linear Regression Analysis With OrangeThinkInnovation

High Profile Call Girls Service in Jalore { 9332606886 } VVIP NISHA Call Girl...kumargunjan9515

Gulbai Tekra * Cheap Call Girls In Ahmedabad Phone No 8005736733 Elite Escort...gragchanchal546

Top profile Call Girls In Chandrapur [ 7014168258 ] Call Me For Genuine Model...gajnagarg

Jual obat aborsi Bandung ( 085657271886 ) Cytote pil telat bulan penggugur ka...Klinik kandungan

Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...Valters Lauzums

Elasticsearch 1.x Cluster Installation (VirtualBox)

1. کارگاه پردازش داده توزیع شده پردیس- شهیدبهشتی دانشکده علوم و مهندسی کامپیوتر درس: پایگاه داده توزیع شده استاد: دکتر هادی طباطبایی ارائه: ابوالفضل صدیقی آذر ۱۳۹۳

2. 2 Elasticsearch Cluster Installation Amir Sedighi @amirsedighi http://hexican.com Dec 2014

3. 3 References ● http://www.elasticsearch.org ● http://www.elasticsearch.org/guide/en/elasticsea rch/guide/current/index.html

4. 4 Topics ● Assumptions ● First Node – Java Installation – Downloading and Extracting Elasticsearch – Configuration ● Cloning ● Starting ES Cluster ● ES REST API ● ES General Concepts – Index, Shard, Segment – Plugins ● River ● CSV ● JDBC ● Feeder ● ES Commands ● ES GUIs – Cluster Monitoring – Analytical Search and BI

5. 5 Assumptions ● You already know about Linux. – http://www.slideshare.net/AmirSedighi/distrinuted-data- processing-workshop-sbu

6. 6 Installing Java ● $ sudo apt-get install default-jdk

7. 7 Downloading and Extracting ● http://hadoop.apache.org/releases.html ● $ tar -zxvf elasticsearch1.3.2.gz

8. 8 Elasticsearch Configuration ● You would need to modify elasticsearch.yml and append the following as a minimum configuration cluster.name: hexican name.name: "node1" node.master: true node.data: false

9. 9 Elasticsearch configuration ● Minimum ● Rich

10. 10 Reboot ● $ sudo reboot

11. 11 Cloning ● Clone the first machine and extend your cluster. – Find the instruction here: ● http://www.slideshare.net/AmirSedighi/distrinuted-data-processing- workshop-sbu

12. 12 Plugins

13. 13 Plugins

14. 14 Plugins ● River ● Feeder

15. 15 Starting Elasticsearch Cluster ● You can run nodes one by one – $ elasticsearch-1.3.4/bin/elasticsearch ● You can run all nodes at once using DSH – $ dsh -M -a – 'elasticsearch-1.3.4/bin/elasticsearch'

16. 16 River

17. 17 River

18. 18 River

19. 19 Shutdown Cluster $ curl -XPOST 'http://localhost:9200/_cluster/nodes/_all/_shutdown'

20. 20 Cluster Health

21. 21

22. 22 Cluster Health

23. 23

24. 24

25. 25

26. 26

27. 27