Flat File Database - Data Transfer Operations

Data Transfer Operations

Flat Files are used not only as data storage tools in DB and CMS systems, but also as data transfer tools to remote servers (in which case they become known as information streams). In recent years, this latter implementation has been replaced with XML files, which not only contain but also describe the data. Those still using Flat Files to transfer information are mainframes employing specific procedures which it is too expensive to modify. One criticism often raised against the XML format as a way to perform mass data transfer operations is that file size is significantly larger with respect to that of Flat Files, which is generally reduced to the bare minimum. The solution to this problem consists in XML file compression (a solution that applies equally well to Flat Files), which has nowadays gained EXI standards (i.e., Efficient XML Interchange, which is often used by mobile devices). It is advisable that transfer data be performed via EXI rather than Flat Files because defining the compression method is not required, because libraries reading the file contents are readily available, and because there is no need for the two communicating systems to preliminarily establish a protocol describing data properties such as position, alignment, type, format, etc. However, in those circumstances where the sheer mass of data and/or the inadequacy of legacy systems becomes a problem, the only viable solution remains the use of Flat Files. In order to successfully handle those problems connected with data communication, format, validation, control and much else (be it a Flat File or an XML file data source), it is advisable to adopt a Data Quality Firewall.