They are not the only person who uses the words for each other. When I was doing my undergrad I found that myself and my fellow students used them pretty loosely goosey. As a native English speaker I’ve never had any difficulty telling which way a speaker intended labor and work to mean. The context provided enough. I can see how for people who are not native English speakers, but this isn’t an academic institution. In casual conversation either or are appropriate.