From day one and To begin with

To begin with and from day one are semantically related. In some cases you can use "To begin with" instead an adverb phrase "From day one".

To begin with adverb - Before now.

From day one and to begin with are semantically related. You can use "From day one" instead an adverb phrase "To begin with".