Tag: connect

ElasticSearch: High Level Rest Client Connection

This entry is part 1 of 4 in the series ElasticSearch High Level Rest Client

In this tutorial I will show you how to use the ElasticSearch high level rest client.

First you will need to add the low level rest to the pom.

  1. <properties>
  2. 	<elasticSearch.version>6.2.4</elasticSearch.version>
  3. </properties>
  4.  
  5. <dependency>
  6.     <groupId>org.elasticsearch.client</groupId>
  7.     <artifactId>elasticsearch-rest-high-level-client</artifactId>
  8.     <version>${elasticSearch.version}</version>
  9. </dependency>

Next you will need to specify the imports.

  1. import java.util.List;
  2. import java.util.ArrayList;
  3. import java.util.Arrays;
  4. import org.apache.http.HttpHost;
  5. import org.elasticsearch.client.RestClient;
  6. import org.elasticsearch.client.RestClientBuilder;
  7. import org.elasticsearch.client.RestHighLevelClient;

Now you can connect to ElasticSearch.

  1. final List hosts = new ArrayList<>(Arrays.asList("localhost"));
  2. final Integer port = 9200;
  3. final String scheme = "http";
  4. 		
  5. final HttpHost[] httpHosts = hosts.stream().map(host -> new HttpHost(host, port, scheme)).toArray(HttpHost[]::new);
  6.  
  7. final RestClientBuilder restClientBuilder = RestClient.builder(httpHosts);
  8. final RestHighLevelClient restHighLevelClient = new RestHighLevelClient(restClientBuilder);

Now you can do whatever you need to!

ElasticSearch: Low Level Rest Client Connection

This entry is part 1 of 3 in the series ElasticSearch Low Level Rest Client

In this tutorial I will show you how to use the ElasticSearch low level rest client.

First you will need to add the low level rest to the pom.

  1. <properties>
  2. 	<elasticSearch.version>6.2.4</elasticSearch.version>
  3. </properties>
  4.  
  5. <dependency>
  6.     <groupId>org.elasticsearch.client</groupId>
  7.     <artifactId>elasticsearch-rest-client</artifactId>
  8.     <version>${elasticSearch.version}</version>
  9. </dependency>

Next you will need to specify the imports.

  1. import org.apache.http.HttpHost;
  2. import org.elasticsearch.client.Response;
  3. import org.elasticsearch.client.RestClient;
  4. import org.elasticsearch.client.RestClientBuilder;

Now you can connect to ElasticSearch.

  1. final RestClientBuilder restClientBuilder = RestClient.builder(new HttpHost("localhost", 9200, "http"));
  2.  
  3. final RestClient restClient = builder.build();

Now you can do whatever you need to!

Hadoop & Java: Connect Remote Unsecured HDFS

In this tutorial I will show you how to connect to remote unsecured HDFS cluster using Java. If you haven’t install hdfs yet follow the tutorial.

POM.xml:

  1. <dependency>
  2. 	<groupId>org.apache.hadoop</groupId>
  3. 	<artifactId>hadoop-client</artifactId>
  4. 	<version>2.9.1</version>
  5. </dependency>

Imports:

  1. import org.apache.hadoop.conf.Configuration;
  2. import org.apache.hadoop.fs.FileSystem;
  3. import java.net.URI;

Connect:

  1. //Setup the configuration object.
  2. final Configuration config = new Configuration();
  3.  
  4. //If you want you can add any properties you want here.
  5.  
  6. //Setup the hdfs file system object.
  7. final FileSystem fs = FileSystem.get(new URI("hdfs://localhost:50070"), config);
  8.  
  9. //Do whatever you need to.