In case the title is confusing, 'goy' is Yiddish for non-Jew, goyim is the plural. Now, why would such a thoroughly goyish family have a book on Yiddish? For that matter, why would that family have an Elijah cup? (A cup traditionally used during the Passover.) Well, why not? We worship a Jew, after all.