vowpal wabbit (vw) supports out-of-core learning with --save_resume. This is what the --help options tells the end user about the
vw
--save_resume
--help