I can't see Android via Ubuntu
... as being easier to use that straight Android, but "hijacking" Android is exactly what I mean. The appeal will not be that Android is easier to use, but that you can plug your machine into a desktop peripherals setup and 'automatically' run a full Ubuntu desktop from your phone, accessing the same data as your Android apps access.
This calls for full integration of Android into Ubuntu at some point (meaning launching Android apps from the Ubuntu UI and accessing the same data). This indeed could be perceived as "easier to use" by those who like the Ubuntu UI, but I think "integrated" is the more important factor.
By the way, after 2 years using Android on my Nook Color (still on 2.3 but playing with 4.2) I have found very few instability or ease-of-use issues, beyond what one would expect from a nascent OS on an unsupported system. I think the reported lag and instability problems are more related to selecting bottom-end phones and expecting top-end performance (as in "I got my free Android phone from the grocery store, and find it laggy. Android sucks!).