In a small pot, combine milk and honey and heat to just above luke-warm. The milk should feel warm but not very hot.
Mix in yeast package and set aside for ten minutes. *Note: if in ten minutes you do not see a foam forming, you need to repeat this step as the yeast is not active.
In a medium bowl, whisk together the dry ingredients (flour, baking soda, baking powder, and Xanthan gum).
In a large power mixing bowl, beat together the eggs, lemon juice, and olive oil for about 30 seconds on medium.
Add yeast mixture and beat another 30 seconds.
Add dry ingredients and beat for 4-5 minutes on medium.
Spray a bread pan with non-stick spray and spray a rubber spatula (it makes spreading the super sticky dough easier).
Shape dough in pan and allow to rise for about 10 minutes. You may not see very noticeable changes and that is OK.
Bake for about 40 -45 minutes. If it is browning too fast, cover with aluminum foil.
Remove from oven and let cool some before slicing.