Showing posts with label spring. Show all posts
Showing posts with label spring. Show all posts

19 July 2014

Open Source ETL

ETL Tools are fundamental these days to an enterprise data workflow process especially as part of data integration. Firstly, data is extracted from external sources. The data is then transformed through a quality assurance process to meet specific needs. The data is then loaded to the target database. With extensive and diverse big data needs, the role of ETL tools has become ever more important for data processing requirements. There are plenty of commercial and open source tools in the market. Sometimes designing one's own solution suffices over a third party option. The below is a list of tools and libraries that may be available open source alternatives with their own unique approaches and limitations. One can also always utilize the cloud especially AWS EMR for same purpose of ETL.

23 March 2014

Spring for Big Data

Over the last few years, SpringSource has been really pushing more modular projects in the Big Data and Cloud arena. There are projects being spun up to resolve complex issues and make life easier for developers as a whole often at the ease of making most of such development needs accessible freely. Some of the solid new projects that have come on are Spring XD, Spring Data, Spring YARN, Spring Hadoop, and Spring Batch. They all attempt to resolve context specific issues via separation of concerns and incorporate more in way of developer productivity. 

Spring Boot

Spring Boot is a new and evolving platform which has only recently had a milestone. Perhaps, it is an alternative being incorporated in order to improve or replace the often flawed and frustrating tooling of Spring Roo. The platform takes on an opinionated view to ease and reduce the ramp up time for rapid development of projects by users. It builds on the existing modules of Spring to provide a further enhancement for flexibility for production-grade development of projects and allow one to use what they need based on evolving requirements. One core feature of the approach is to move away from code generation and excessive use of XML configurations. It even incorporates Groovy scripts at the command line. Perhaps, the approach is also taking much inspiration from the Play framework but adjusting the flexible needs of a typical Spring developer. The approach also means more help features to ease developer productivity especially alongside cloud deployments and Web services. 

11 December 2013

Restful By DropWizard

There are now quite a few useful options available for developing Restful applications within Java frameworks. However, from a business standpoint it is still about rapid turn around time and project management which is key for developing Restful services with correctness. The usual routes are Spring Rest, Play framework, JEE stack, Apache CXF and friends, or Restlet. One more framework that Yammer have decided to use specifically for the purpose of rapid development and integration for services is Dropwizard. This framework pretty much ties in other mature libraries together saving time for ops, checking for high performance, and to build into a light-weight package. The framework has support for configuration, metrics, logging, ops tools, and more.  Quite a useful Restful focused framework for getting things done.

Also, if one is new to REST, there is an interesting RestExpress Tutorial.