Empirical Hypothesis Testing & Experiment Protocol
Builds a rigorous scientific experiment protocol to validate prompt strategies or model parameters with statistical confidence.
Design a controlled empirical experiment protocol to test the following research hypothesis: [INSERT HYPOTHESIS HERE] Protocol Requirements: 1. Variables: Define the Independent, Dependent, and Controlled variables with exact operational definitions. 2. Sample Sizing & Power: Calculate required sample count for 95% statistical power at p < 0.01. 3. Confound Mitigation: Outline blinding procedures, temperature/seed freezing, and prompt variation randomizations. 4. Evaluation Metric: Specify the exact statistical tests (e.g. Mann-Whitney U, McNemar's) to validate significance.