Background of the ETL Tool Survey


Survey motivation and set-up

Since 2003, the consultancy and research firm Passionned has been closely monitoring the market for both ETL and data integration tools. In the past, the focus was on the well-known market leaders who were often regarded as visionaries and leaders. Many organisations used to assume that they had automatically made the right choice if they purchased a tool from one of the market leaders. Since the late nineties, however, the market has changed substantially. Practically all the major BI vendors have purchased or developed their own ETL tools. Given that a central data warehouse is one of the major cornerstones of a successful BI solution, their choice to move into the ETL marketplace is understandable.. After all, 70-80% of the costs involved in a successful BI system are infrastructure, creating reliable ETL processes and a well designed method of keeping the data warehouse current is essential.

The primary reason why we should evaluate ETL tools carefully and focus on the BI infrastructure, is because it can ensure that creating reports and business score cards is much easier, enabling the business users to select the information relevant to them in the blink of an eye.

"The time and effort invested in a proper ETL design and the selection of a ETL tool, will be paid back time and time again.", said Daan van Beek, ETL industry expert and founder of Passionned.

Thomas Siebel, the founder of Siebel, (now Oracle) was quoted in an interview: "Organizations may save a lot of money when valuable data stored throughout the organization in seperated silo's can be integrated and combined".

The second reason to evaluate and promote ETL tools, is that many organizations still build their data warehouse by hand, writing complex SQL and stored procedures. Many organisations still find themselves in the ‘stone age’. Data warehouses are still being developed manually using either SQL or PL/SQL, while developer productivity would be increased by a factor of three to five if a proper ETL tool was used. Additionally, the reliability and stability of data warehouses built using an ETL tool is much higher, since more aspects can be checked and monitored in relation to each other, metadata being a case in point. It should, however, be noted that merely using an ETL tool does not automatically guarantee success.

Thirdly and finally: Gartner’s EIM Magic Quadrant only provides an overview of ETL tools. It was never intended to provide a complete basis for selecting an ETL tool. In this survey an objective classification of ETL tools is given in all the essential categories, by considering over 80 criteria.

How the ETL tools Survey is carried out

  • A list of 80 criteria was developed as a basis for the comparison, using input from the developer community and focussing on characteristics that play a major role in the quick development of a successful BI infrastructure.

  • Passionned conducted in-depth interviews with all the vendors listed on the 'List of ETL tools' page regarding their ETL solutions.

  • In addition, vendors were given the opportunity to provide a live, two-hour demonstration in order to present the functionality of their ETL tool. PowerPoint presentations were avoided as much as possible. During these demos, Passionned evaluated whether the tool was able to handle particular situations by means of Q&A sessions. Where there was still doubt, Passionned gave the tool either zero or half a point.

  • Vendors were asked to provide list prices for their tools by an official Request for Proposal (RFP), with two configurations (see also the criteria). This only gave a price indication since all the products are priced in different ways.

  • In many cases an intensive dialog took place between Passionned and the vendors to obtain answers to outstanding questions. Ambiguous or misleading answers were not accepted. All answers were confirmed in writing by the suppliers to avoid misunderstandings.

  • Finally, a number of developers from end-user organisations as well as BI consultants provided feedback with regard to the results of the ETL study. Whenever the necessary, further investigation took place and the evaluation was altered accordingly.

Lees verder List of ETL tools studied
Lees verder Aspects and criteria explained
Lees verder Ranking of the ETL tools by aspect
Lees verder Download the ETL Survey Report

Back to the homepage of etltool.com