Again and By and by

By and by and again are semantically related in repeated topic. In some cases you can use "By and by" instead an adverb "Again".

By and by adverb - At or within a short time.

Again and by and by are semantically related in later topic. Sometimes you can use "Again" instead an adverb phrase "By and by", if it concerns topics such as happening after.