[
https://issues.apache.org/jira/browse/HIVE-21705?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthew Liem updated HIVE-21705:
--------------------------------
Description:
In some situations, users may want the ability to customize the hive file
output name beyond the current implementation of taskId. Mapreduce has a
similar feature with "mapreduce.output.basename" and the proposed solution is
to have a similar hive conf setting "hive.output.file.prefix" that will be
appended to hive output file names.
The idea is to allow users to specify prefix for hiveoutput files. e.g
set hive.output.file.prefix=""
The change would happen in the tmpPath -> finalPath rename and would require us
to modify getFinalPath in the FileSinkOperator class and pass in a prefix from
a newly created HiveConf.ConfVars.OUTPUT_FILE_PREFIX
I can work on this but wanted to first check with what others are doing and
have planned for the project.
was:
In some situations, users may want the ability to customize the hive file
output name beyond the current implementation of taskId. Mapreduce has a
similar feature with "mapreduce.output.basename" and the proposed solution is
to have a similar hive conf setting "hive.output.file.prefix" that will be
appended to hive output file names.
The idea is to allow users to specify prefix for hiveoutput files. e.g
set hive.output.file.prefix=""
The change would happen in the tmpPath -> finalPath rename and would require us
to modify getFinalPath in the FileSinkOperator class and pass in a prefix from
a newly created HiveConf.ConfVars.OUTPUT_FILE_PREFIX
> Allow user to specify file prefix for hive output files
> --------------------------------------------------------
>
> Key: HIVE-21705
> URL: https://issues.apache.org/jira/browse/HIVE-21705
> Project: Hive
> Issue Type: New Feature
> Affects Versions: 2.3.4
> Reporter: Matthew Liem
> Priority: Minor
>
> In some situations, users may want the ability to customize the hive file
> output name beyond the current implementation of taskId. Mapreduce has a
> similar feature with "mapreduce.output.basename" and the proposed solution is
> to have a similar hive conf setting "hive.output.file.prefix" that will be
> appended to hive output file names.
> The idea is to allow users to specify prefix for hiveoutput files. e.g
> set hive.output.file.prefix=""
> The change would happen in the tmpPath -> finalPath rename and would require
> us to modify getFinalPath in the FileSinkOperator class and pass in a prefix
> from a newly created HiveConf.ConfVars.OUTPUT_FILE_PREFIX
> I can work on this but wanted to first check with what others are doing and
> have planned for the project.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
