Hi MAX-- welcome to the addiction site of VX'ers. Yes, everything bad you've heard is true with regards to P.I.T.A. backseat, poor rear window visibility, 17 -- 20 MPG, and not to forget very finicky electric windows (getting stuck in the down window position).
Since the VX is a 2-door SUV (PUV), and you having very small/young children-- you will absolutely hate transporting your kids in the back seat. Plus, the C-Pillar is dead in the way of the rear passengers outside view and they only have tunnel vision looking forward through the windshield over the parents shoulders. Your kids will soon be screaming because they can't see out and watch the world go by. Most VX owner's remove the rear seat altogether because it's a royal P.I.T.A. You will find that 99.99% of all VX owner's are either single, or married without kids for this very reason. Those that do have kids, will also have a "family" type 4-door vehicle in their driveway for family related outings.
There are member's that do use the VX as a daily driver, and many others that do not. A better daily driver commuter car may be a more fuel efficient vehicle like a Hyundai/Kia/Toyota, etc. I also own a '78 FJ-40 and it sits next to my VX in the garage, as neither is a daily driver.
Not to discourage you from the VX, but perhaps a more "family oriented" SUV may be a nicely used Nissan X-Terra which has 4-doors and is more vision-friendly for young kids wanting to look out the side windows. The VX is not very family friendly and is the #1 reason why they are often sold (oftentimes after a new baby comes along).
Max, our very best wishes to you whatever your final decision and thank you for your interest in the VX.