Valentyn Tymofieiev created BEAM-6532: -----------------------------------------
Summary: BigQuery IO does not working in Python 3
Key: BEAM-6532
URL: https://issues.apache.org/jira/browse/BEAM-6532
Project: Beam
Issue Type: Sub-task
Components: sdk-py-core
Reporter: Valentyn Tymofieiev
Suspecting an issue in apitools library, similar to one [~markflyhigh]
discovered for GCS in BEAM-6154.
{noformat}
WARNING:root:Retry with exponential backoff: waiting for 7.8972419555895
seconds before retrying get_table_location because we caught exception:
TypeError: the JSON object must be str, not 'b
ytes'
Traceback for above exception (most recent call last):
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/utils/retry.py",
line 184, in wrapper
return fun(*args, **kwargs)
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/io/gcp/bigquery_tools.py",
line 421, in get_table_location
table = self._get_table(project_id, dataset_id, table_id)
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/utils/retry.py",
line 197, in wrapper
raise_with_traceback(exn, exn_traceback)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/future/utils/__init__.py",
line 421, in raise_with_traceback
raise exc.with_traceback(traceback)
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/utils/retry.py",
line 184, in wrapper
return fun(*args, **kwargs)
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/io/gcp/bigquery_tools.py",
line 333, in _get_table
response = self.client.tables.Get(request)
File
"/home/valentyn/projects/beam/beam/beam/sdks/python/apache_beam/io/gcp/internal/clients/bigquery/bigquery_v2_client.py",
line 579, in Get
config, request, global_params=global_params)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/base_api.py",
line 731, in _RunMethod
return self.ProcessHttpResponse(method_config, http_response, request)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/base_api.py",
line 737, in ProcessHttpResponse
self.__ProcessHttpResponse(method_config, http_response, request))
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/base_api.py",
line 620, in __ProcessHttpResponse
return self.__client.DeserializeMessage(response_type, content)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/base_api.py",
line 446, in DeserializeMessage
message = encoding.JsonToMessage(response_type, data)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py",
line 123, in JsonToMessage
return _ProtoJsonApiTools.Get().decode_message(message_type, message)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/py/encoding_helper.py",
line 309, in decode_message
message_type, result)
File
"/home/valentyn/tmp/venv/py3env/lib/python3.5/site-packages/apitools/base/protorpclite/protojson.py",
line 212, in decode_message
dictionary = json.loads(encoded_message)
File "/usr/lib/python3.5/json/__init__.py", line 312, in loads
s.__class__.__name__))
{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
