Spatial ETL with Talend: New version of GeoSpatial Integration supports Linear Reference System
Disy extends plug-in "GeoSpatial Integration for Talend" in version 2.1 / New functionality for processing linear referenced data (LRS) in Talend / Plug-in enhanced by Douglas-Peucker algorithm supporting Talend 7.2.
Disy Informationssysteme GmbH has enriched the Spatial ETL plug-in "GeoSpatial Integration for Talend" with new functionalities to suit the latest Talend version 7.2. Companies and authorities using the linear reference system for calculations and map presentations can now use the Talend platform, including the spatial add-on for calculations, in the data integration process. This is particularly significant for transport, traffic, logistics and road construction branches as well as the mineral oil industry. Additionally, an integrated Simplify algorithm is available as a calculation option.
Dr. Wassilios Kazakos, Head of Marketing, Business Development, explains the software innovations: "The new version 2.1 of our Spatial ETL extension for Talend opens completely new fields of application regarding Talend’s data management platform. Supporting the linear reference system, for example, benefits businesses and authorities in infrastructure, transportation and road construction, where LRS is widely used."
Linear Referencing Support
GeoSpatial Integration for Talend includes functionalities for linear referencing (LRS) as of version 2.1. In this context, features or events with spatial relation are defined by the relative position along from a fixed point a line, e. g. a milestone along a road. The method is used in particular to manage data in road construction, the railway sector, in connection with oil and gas pipelines, electricity and data pipelines or in the context of rivers.
The Spatial ETL plug-in is now able to read and write the coordinates used during the LRS process in GeoJSON format and from Oracle databases. In addition, the plug-in has been extended by corresponding calculation options. For example, the distance between the starting point of a bus line and any other point coordinate (a bus stop) can now be calculated. Also, the distance from the bus stops to the street center or their positions in relation to the travel direction may be determined. If defined road sections such as no parking zones next to bus stops are recorded in coordinates, GeoSpatial Integration for Talend identifies the distances using the start and end coordinates and saves them in a file.
This unlocks completely new ways of data management for authorities and companies in the fields of transport, traffic, logistics, road construction or the petroleum industry, while maintaining the usual referencing: data pipelines from any source can be created, managed, transformed, shared and processed - on the unified Talend data platform. It comprehensively and reliably integrates all data types while achieving outstanding performance. The plug-in developed by Disy integrates seamlessly into the Talend tool palette and expands it by spatial functionalities.
Douglas-Peucker Algorithm for Simplifying Geometries (Simplify) Support
GeoSpatial Integration for Talend has been extended with another Simplify algorithm, the so-called Douglas-Peucker algorithm.
The Douglas-Peucker algorithm (also: Ramer-Douglas-Peucker algorithm) facilitates the thinning of vertices and simplifies curves or lines by omitting individual points in the defined traverse, while the shape of the track is retained. Simplify algorithms generally contribute to a reduction in vertex calculation, therefore resulting in reduced data volume. Accordingly, the calculation time is shortened. From an economic point of view, the two factors volume and time have a significant financial impact, especially in terms of regularly occurring calculations caused by data updates.
The Simplify algorithm proposed by Visvalingam-Whyatt has already been added to the Spatial ETL plug-in 2018. This function also simplifies linear and polygonal geometries. With the addition of the second simplification algorithm in GeoSpatial Integration for Talend, users have the opportunity to select their preferred Simplify method.
Download GeoSpatial Integration for Talend for free
Geospatial Integration for Talend for Talend Open Studio can be downloaded for free at Disy‘s website www.disy.net/en/geospatial-formular/. For Talend customers in need of professional support or interested in using the Talend Studio plug-in or one of the Talend platforms, a commercial version is available as a subscription or bundle with one of the Talend platforms.