Power
Yeah, you can go ahead and put that whip away. Thanks to international human rights legislation and stuff like that, you have a little less power than an average tea plantation owner in the nineteenth-century maybe did. But you've still got a lot of it. At the plantation itself, your word is basically law. The pickers work the hours you tell them to, and the overseers report to you.
But of course, you aren't actually a monarch. Your livelihood depends on your ability to sell your bushels of tea leaves to huge tea corporations. Which means, at the end of the day, you still need to grow what they (and the consumers) want to purchase. And when all of your workers pull out the torches and pitchforks, well, being the only owner on the plantation might come back to bite you.