Data Refresh – synchronise Appian databases across environments

Procensol > Procensol Labs > Data Refresh – synchronise Appian databases across environments

Brief summary

Refreshing the way you view the task of synchronising database contents and structures.

Whilst Appian has recently released considerable improvements regarding automated deployments & CICD (between environments), the task of synchronising database contents/structures has remained manual and tedious, typically requiring a dedicated DBA and substantial time investment.

 

Share:
Print
+100%-

Get Data Refresh now - live on the Appian Marketplace

Source:

Author Image

Ritesh Pareek

Consultant

Data Refresh has been created to alleviate the problems associated with synchronising database contents/structures. It is a utility providing simple, automated import/export processes complete with variable obfuscation types, enhanced security measures, backup procedures, and customisable export profiles.

Once installed, an export profile needs to be configured, comprising table selections and obfuscation configurations. After nominating the tables to be included in the profile, an array of obfuscation methods is made available, including fixed-length randomisation, preserved length (respective to the column definition) randomisation, or substitution with a static value. These methods are implemented at a column-level, ensuring sensitive production data can remain confidential, whilst still migrating realistic, manageable values.

Initiating a profile will return a progress gauge, depicting the overall process completion in real-time. Meanwhile, the requested database content is being fetched, assembled, obfuscated, consolidated and zipped. These stages can be relatively resource intensive, however we’ve sufficiently balanced the load through both batch-processing (with each new process being instantiated on a new Appian engine) and file rolling (throttling based on line/file-size limits).

Upon completion, the target system will attempt to import the prepared package, though not without the requisite password being provided, safeguarding against accidental or unintended imports. Additionally, as a further security measure, passwords are algorithmically hashed and time-sensitive. Data Refresh also allows one-click, flat-file backups of all SQL (DML/DDL) associated with a given profile, which (much like imports and exports) is password protected.

All functionality listed above pertains to the launch version of Data Refresh, with plans for new obfuscation types, non-MySQL database support and additional features in future releases.

You’ll never see data synchronisation the same way again.

See more on our website or

Check out Procensol’s Data Refresh – now available in the Appian App Market

Author image

Roopesh Rambhatla, Ritesh Pareek & Matt Brennan

About the Author:This article was jointly submitted by Roopesh Rambhatla, Ritesh Pareek and Matt Brennan from Procensol Australia.