Data Consolidation delivers value and efficiency

By: Sysware  05-Apr-2012
Keywords: Data Warehouse, Data Integration

The client needed to reduce the complexity of job processing within its data warehouse. Sysware successfully tendered for the job and promptly delivered a cost-effective solution on time, to budget, meeting all expectations for cost, performance and quality

The data warehouse is a major operational system, with a database that contains over 800 tables. It is also a distributed application split into five regional instances, with a structurally identical database existing for each region.

Data was staged and loaded to the data warehouse on three levels:

  • Level 1 held atomic level data from the five source systems, storing current and historical views of data.
  • Level 2 conformed and normalised the data from the source systems.
  • Level 3 contained aggregated and detailed data, modelled dimensionally.

The level 2 data drew directly on all five level 1 sources, causing complexity and delays in processing. A new SAS dataset was needed between levels one and two, to streamline the complexity of level 2 jobs.

Using SAS Data Integration Studio (DIS), Sysware quickly delivered the project, enabling the required improvements, including:

  • More efficient records processing.
  • Data volume changes processed in a linear manner.
  • Improved timescales for the completion of catch-ups following outages, with data chunked for processing if required.
  • Automatic recovery from failure, restoring data to a consistent state.
  • The ability to enter new tables into level 1.5 without code changes.
  • Alerts when structural differences are identified in tables across regions.
  • Full documentation and handover to the client’s development team.

Our client was very satisfied with the results. Sysware quickly delivered an efficient and competitively priced solution that matched the brief and fulfilled all objectives.

Keywords: Data Integration, Data Warehouse

Other products and services from Sysware


Powering Up – Building a Data Warehouse

The project included providing OLAP data structures for end users to exploit, the development of web-based reporting for end users; and the establishment and optimisation of the reporting architecture. To be able to participate in this sharing of the electricity market, this power utility had to build an ultra-reliable data warehouse that collected real-time power pricing data 24 by 7.


Business Intelligence Solutions

We’ve worked with many leading organisations, helping them to increase their profits, optimise business and technical performance, analyse and report on their data, develop and implement powerful customer retention strategies and reduce their operating costs. By combining data mining with traditional audit techniques, you create effective and efficient tests for making cost recoveries, discovering revenue opportunities and identifying fraud.


Using Predictive Modelling to Reduce Churn

The marketing team decided to focus on high value customers who were most likely to leave and asked Sysware to help carry out a predictive modelling exercise to identify these customers. The data was fed into a SAS predictive modelling tool that uses neural networking techniques to build a model to predict churn behaviour and factors with little or no influence were removed.


Predictive Analytics Increase Sales, Reduce Campaign Costs

Sysware was proud to be involved in such a successful collaborative exercise, which provides compelling evidence on the success of targeting on increasing sales and reducing costs. By utilising Sysware’s data mining expertise and Mapnet’s mapping capability, the client achieved a vastly improved response rate, and a huge return on their investment.