Going Big by Getting Small