If the time frame is 1730s, YDNA is your best bet. atDNA only works very well on more recent connections between 1800 and 1850. As you go prior to 1800, most of your ancestors randomly can no longer be detected unless you start testing all of your lines via uncles/aunts, cousins, etc.
mtDNA has very little genealogical application. This is due to the size of this particular piece of DNA which is not part of the nucleus and is only 16,000 base pairs long. Since it is so small, this is really only an ancient history test to develop how womankind settled the earth. Currently, YDNA is now being used for 18,000,000 base pairs (getting pretty close to the maximum that will be readable). Eventually, YSTRs (500) and YSNPs will allow us assign several mutations to each male on our pedigree chart. Unfortunately, it will require testing costs to come way down (the best YCHR discovery test is still $2,950 which cover almost twice as much as the Big Y test) and it will require the number of testers to increase by at least ten fold (we currently have only a 30 % growth per year). Eventually, YDNA will probably replace atDNA testing in the next 10 to 20 years. atDNA will still remain a good tool to get started with though.
For YDNA, you need to always start out with 67 markers from FTDNA - 111 markers is not really needed unless you get lucky and have a very large surname cluster (500 markers from Whole Genomes Sequencing tests will start being used in the next year or so). The next step would be order any appropriate YSNP pack (some of these are getting down the 1,500 year time frame down to even 100 to 200 years in a very few cases where extensive testing is being done).
However, an alternative to SNP pack testing is testing private YSNPs at YSEQ if you have a close match with a NGS/WGS tester (Big Y, etc.). Of course NGS testing and recently WGS testing is your only option to reveal YSNPs that become tomorrow's branches of mankind. Prices are still pretty steep from $450 on sale, low resolution at $575, medium resolution from Full Genomes Corporation $775 (30 % more content for 30 % more cost) or high resolution with the long read FGC test (100 % more content but at a steep 500 % more cost - prices will fall though). Also, YSEQ now offers WGS tests as well. Over the next year or two, all NGS testing will be replaced by WGS testing since WGS will come down much faster (prices are almost the same now). You will get a free full mtDNA test included in the WGS (to me, not that useful).