The tool I'm working on is used to process large number of documents. Recently, I've implemented small feature for this tool. The feature affects some % of all documents. After few days I received a message from other engineer that size of documents we processed increased substantially and one of the possible reason behind it is my change. I want to measure if it's true. I have following data for each document we processed:
- processing time
- flag indicating if my feature affected the document
- document size
How can I measure hypothesis whether my change could cause increase in documents' size? The system is complicated, so it could happen by (non-deterministic) interaction with other components. I would like to come up with some metric that could tell me if it's the case.