FAQs
1. Is running the Sensitive Data Discovery pipeline necessary before the Data Masking pipeline?
Although it is recommended to run the Sensitive Data Discovery pipeline prior to running the Masking pipeline, it’s not a requirement. Users can manually perform the steps that the SDD pipeline automates ( create file formats and upload to engine ).
2. I keep hearing “file format”. What exactly is a file format?
Think of file formats as table metadata to keep things simple. Delphix Masking Engine needs to be aware of which columns are present in the files that need to be masked since we are masking csv files rather than direct databases. For more information please visit Delphix Masking Documentation.
3. What does file format clean-up mean and why is it required?
The Sensitive Data Discovery pipeline uploads file formats to the Delphix Engine. Over a period of time the Delphix Engine would be filled with these file formats and further upload might cause issues. So we need to clean up unused and modified file formats from the Delphix Engine.
4. What conditions are to be met for the Sensitive Data Discovery pipeline to do file format cleanup?
- The pipeline is being triggered for the same schema a second time or more.
- The parent folder on the blob store i.e the ContainerRootFolder parameter is the same.
- The table’s column name or number of columns have changed.
- No file is linked to the file format that will be removed from the Delphix Masking Engine.
5. How do I get my file share’s URL, username, and password?
Go to the step 7 in the microsoft document. Click on the show script button and you should be able to see all the above details.
6. How do I unlink a file format from a file for it to be eligible for clean up?
Delphix Engine only allows you to link and delete a file format there is no option to edit one. So you just need to delete the file from the ruleset. For more details check Delphix Masking Documentation.