Provided herein are systems and methods for user-defined automated document feature modeling, extraction and optimization. In the present disclosure, an end user of an automated document review system can customize and create new data models applicable to a set of focus documents. In addition, an end user of the automated document review system can customize and create new extraction rules applicable to text extraction from the set of focus documents. The user-defined edits to the data model and extraction rules can be further tested in a staging environment, and tested against a ground truth set of documents, before being widely applied to other relevant documents.