Spring Framework for Apache Hadoop 2.3.0 GA released

Ads

Tutorials

Advantages of Spring Framework Spring 4 Introduction and example Features of Spring Framework 5 How to make Spring web Login form? How to make Simple form in Spring web? Spring, Hibernate login and registration application Spring Framework Tutorial for beginners with examples Spring Framework for Apache Hadoop 2.3.0 GA released Spring Framework 4.1 GA is released with major features Why to use Spring Framework? Spring Framework 4.1 - First Release candidate available Spring IO Platform 1.0.0 Released Spring 4: Login Form using Spring MVC and Hibernate Example Spring 4 MVC Login form Example with source code Spring 4 MVC Hello World Example: Spring 4 MVC Tutorial will full source code Spring Web MVC Application Error:ClassNotFoundException: DispatcherServlet on deploying Features of Spring 4 Spring Framework 4.0 released Spring Framework 4: Spring Framework 4 Tutorials and Example Spring Integration 3.0 Release is released and available for download Spring Tutorial for Beginners Java Springs Framework Tutorial Spring Architecture Spring Framework Tutorials database spring registration form Spring Login Example Roseindia Spring Tutorial Spring Tutorial Spring 3.2 MVC insert and retrieve blob from the database The hidden tag The errors tag net.roseindia.dao net.roseindia.service net.roseindia.model net.roseindia.controller Spring 3.2 MVC Hibernate Example Spring 3.2 MVC, Upload File in a specific folder Spring 3.2 MVC Form Handling The textarea tag The options tag

The version of Spring for Apache Hadoop 2.3.0 is released on 22nd December 2015 and this release comes with new features and many improvements. In this post we are examining the features added to this release.

Spring Framework for Hadoop helps the developers to quickly develop and deploy Hadoop based applications. Spring for Hadoop provides the APIs for using HDFS, MapReduce, Pig, and Hive power in their application.

Following new features and improvements are added to Spring for Apache Hadoop 2.3:

In this release support for Hive 1.x is added and HiveTemplate was updated to work with HiveServer2
A new batch tasklet added for Apache Spark
FlushTimeoutTrigger is also added to StoreObjectSupport which can be used to flush to disk during writes
The internal state machine now implements though new project called "spring-statemachine".
The jobHistoryAddress is added to SpringHadoopProperties for Boot configuration
The build has been updated to use Spring Framework 4.2.4, Spring Batch 3.0.6.RELEASE, Spring Boot 1.3.1.RELEASE and Spring Integration 4.2.4.RELEASE.

This version of Spring framework can be used to run the Apache Spark jobs on the Hadoop clusters. Check our tutorial 'How to setup Apache Spark Development Environment?' for getting started with the Apache Spark Framework.

Version specific artifices support :

2.3.0.RELEASE (default - Apache Hadoop stable 2.7.1)
2.3.0.RELEASE-hadoop26 (Apache Hadoop 2.6.0)
2.3.0.RELEASE-phd30 (Pivotal HD 3.0)
2.3.0.RELEASE-phd21 (Pivotal HD 2.1)
2.3.0.RELEASE-cdh5 (Cloudera CDH 5.4)
2.3.0.RELEASE-hdp23 (Hortonworks HDP 2.3)

How to use Spring Framework for Apache Hadoop 2.3.0 GA?

You can add the following dependency in your pom.xml file:

<dependencies>
    <dependency>
        <groupId>org.springframework.data</groupId>
        <artifactId>spring-data-hadoop</artifactId>
        <version>2.3.0.RELEASE</version>
    </dependency>
</dependencies>

In the Gradle based application following dependency can be used:

dependencies {
    compile 'org.springframework.data:spring-data-hadoop:2.3.0.RELEASE'
}

Spring Hadoop framework allows the developers to create application using Spring, Spring Batch, and Spring Integration which can be deployed on the Hadoop Clusters.

Check our Spring Framework tutorials section.