Frozen-State Value Iteration: Faster Reinforcement Learning by Freezing Slow States

The authors are grateful to the department editor, associate editor, and three anonymous reviewers for their multiple rounds of careful reading and constructive feedback. Their comments helped us catch important issues and substantially improve the paper, including strengthening the organization, sharpening the intuition and exposition, and clarifying key points throughout.