There are numerous books pre-1839, including a German one from 1796, that include rules for baseball, and even use the term "baseball." You need go no further than that to know that the game was played prior to 1839.