Hive join set number of reducers
16,063
At the top of the script file, put this:
set mapred.reduce.tasks=128
Author by
Sandeep
Working on Machine Learning in online advertising domain. Working as a Data Scientist in a Product based company.
Updated on June 04, 2022Comments
-
Sandeep almost 2 years
I need to set number of reducers while doing a join operation in Hive. I don't want to set the same number of reducers to every join job I have. How Can I mention it as an argument? Thanks in advance.