"by accident" sounds wrong. Pretty much everyone I interact with uses "on accident" both in speech and in writing, why would I use the weird sounding version when there's a perfectly good normal sounding version right there? It's not like "could of" where it really is grammatically incorrect, it's a difference in word choice for a phrase.