How will you deal with lines? Will voice recognition know which of your speech pauses are at the end of a book? Or do you need it to have some kind of carriage command it recognizes vocally or otherwise?
I don't really see what voice recognition gives you that makes it easier... after all the data entry aspect is only one aspect of it. You'll want to do something with the data afterwards right? And using voice recognition should be worse in the long term (my humble opinion).
I understand your concern with languages, you being in Switzerland, and that both worsens your chances of efficient voice recognition and finding adequate existing databases.
Still, I think the existing database route is probably the least cumbersome overall. You "just" need to find some bibliophile community, or talk to local librarians, about the software they use and try to get your hands on some less-commercial version of it so the license fees don't kill you. A bit of extra investment to kick it off but I imagine then it would be much smoother going and with data which will be adequately structured for further use.
If you figure something out do tell. I have an Access DB I update manually as I buy new books with titles, ISBN, etc... One of my peeves organizing has been that I read in EN, FR, PL, ES and PT :)