Because they are not. If you are wearing leggings and you are not at the gym, you are not dressed. Also, an oversized sweater and a pair of Uggs do not make leggings into trousers.
Almost no one looks good in leggings. But this is immaterial, because even if you look fantastic in leggings, they are still not clothes.
Seriously? Why is this so hard?