[
https://issues.apache.org/jira/browse/CASSANDRA-16204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Phil Miesle updated CASSANDRA-16204:
------------------------------------
Description:
This seems to be a different issue than Cassandra-14982 :
$ cqlsh --version
cqlsh 6.8.0
Following Datastax Academy course DS220, in the Denormalization exercise. I
received
{code:java}
PicklingError: Can't pickle <class 'cqlshlib.copyutil.video_encoding'>:
attribute lookup video_encoding on cqlshlib.copyutil failed{code}
on the COPY command into the following table:
{code:java}
CREATE TYPE IF NOT EXISTS video_encoding (
encoding TEXT,
height INT,
width INT,
bit_rates SET<TEXT>
);
CREATE TABLE videos_by_actor (
actor text,
added_date timestamp,
video_id timeuuid,
character_name text,
description text,
encoding frozen<video_encoding>,
tags set<text>,
title text,
user_id uuid,
PRIMARY KEY ( (actor), added_date, video_id )
) WITH CLUSTERING ORDER BY ( added_date desc, video_id asc);
COPY
videos_by_actor(actor,added_date,video_id,character_name,description,encoding,tags,title,user_id)
FROM 'videos_by_actor.csv' WITH HEADER = true{code}
Now, as it turns out my PRIMARY KEY was non-unique (noted when I failed to load
as many records as were in the file), and when I changed to:
{code:java}
PRIMARY KEY ((actor), added_date, video_id, character_name){code}
the command worked. BUT the following options also worked (though they both
dropped records):
{code:java}
WITH HEADER = true AND MINBATCHSIZE=1 AND MAXBATCHSIZE=1 AND PAGESIZE=10;{code}
and
{code:java}
WITH HEADER = true AND NUMPROCESSES=1;{code}
So this seems to be a problem of multi-threading and user-defined TYPEs?
I'll note that I'm running inside a WSL2 Docker Container based on
ubuntu:bionic:
$ uname -a
Linux node-1 4.19.104-microsoft-standard #1 SMP Wed Feb 19 06:37:35 UTC 2020
x86_64 x86_64 x86_64 GNU/Linux
was:
This seems to be a different issue than Cassandra-14982 :
$ cqlsh --version
cqlsh 6.8.0
Following Datastax Academy course DS220, in the Denormalization exercise. I
received
{code:java}
PicklingError: Can't pickle <class 'cqlshlib.copyutil.video_encoding'>:
attribute lookup video_encoding on cqlshlib.copyutil failed{code}
on the COPY command into the following table:
{code:java}
CREATE TABLE videos_by_actor (
actor text,
added_date timestamp,
video_id timeuuid,
character_name text,
description text,
encoding frozen<video_encoding>,
tags set<text>,
title text,
user_id uuid,
PRIMARY KEY ( (actor), added_date, video_id )
) WITH CLUSTERING ORDER BY ( added_date desc, video_id asc);
COPY
videos_by_actor(actor,added_date,video_id,character_name,description,encoding,tags,title,user_id)
FROM 'videos_by_actor.csv' WITH HEADER = true{code}
Now, as it turns out my PRIMARY KEY was non-unique (noted when I failed to load
as many records as were in the file), and when I changed to:
{code:java}
PRIMARY KEY ((actor), added_date, video_id, character_name){code}
the command worked. BUT the following options also worked (though they both
dropped records):
{code:java}
WITH HEADER = true AND MINBATCHSIZE=1 AND MAXBATCHSIZE=1 AND PAGESIZE=10;{code}
and
{code:java}
WITH HEADER = true AND NUMPROCESSES=1;{code}
So this seems to be a problem of multi-threading and user-defined TYPEs?
I'll note that I'm running inside a WSL2 Docker Container based on
ubuntu:bionic:
$ uname -a
Linux node-1 4.19.104-microsoft-standard #1 SMP Wed Feb 19 06:37:35 UTC 2020
x86_64 x86_64 x86_64 GNU/Linux
> PicklingError: Can't pickle <class 'cqlshlib.copyutil.video_encoding'>:
> attribute lookup video_encoding on cqlshlib.copyutil failed
> -----------------------------------------------------------------------------------------------------------------------------------
>
> Key: CASSANDRA-16204
> URL: https://issues.apache.org/jira/browse/CASSANDRA-16204
> Project: Cassandra
> Issue Type: Bug
> Components: CQL/Interpreter
> Reporter: Phil Miesle
> Priority: Normal
> Attachments: videos_by_actor.csv.gz
>
>
> This seems to be a different issue than Cassandra-14982 :
> $ cqlsh --version
> cqlsh 6.8.0
> Following Datastax Academy course DS220, in the Denormalization exercise. I
> received
> {code:java}
> PicklingError: Can't pickle <class 'cqlshlib.copyutil.video_encoding'>:
> attribute lookup video_encoding on cqlshlib.copyutil failed{code}
> on the COPY command into the following table:
> {code:java}
> CREATE TYPE IF NOT EXISTS video_encoding (
> encoding TEXT,
> height INT,
> width INT,
> bit_rates SET<TEXT>
> );
> CREATE TABLE videos_by_actor (
> actor text,
> added_date timestamp,
> video_id timeuuid,
> character_name text,
> description text,
> encoding frozen<video_encoding>,
> tags set<text>,
> title text,
> user_id uuid,
> PRIMARY KEY ( (actor), added_date, video_id )
> ) WITH CLUSTERING ORDER BY ( added_date desc, video_id asc);
> COPY
> videos_by_actor(actor,added_date,video_id,character_name,description,encoding,tags,title,user_id)
> FROM 'videos_by_actor.csv' WITH HEADER = true{code}
> Now, as it turns out my PRIMARY KEY was non-unique (noted when I failed to
> load as many records as were in the file), and when I changed to:
> {code:java}
> PRIMARY KEY ((actor), added_date, video_id, character_name){code}
> the command worked. BUT the following options also worked (though they both
> dropped records):
> {code:java}
> WITH HEADER = true AND MINBATCHSIZE=1 AND MAXBATCHSIZE=1 AND
> PAGESIZE=10;{code}
> and
> {code:java}
> WITH HEADER = true AND NUMPROCESSES=1;{code}
> So this seems to be a problem of multi-threading and user-defined TYPEs?
> I'll note that I'm running inside a WSL2 Docker Container based on
> ubuntu:bionic:
> $ uname -a
> Linux node-1 4.19.104-microsoft-standard #1 SMP Wed Feb 19 06:37:35 UTC 2020
> x86_64 x86_64 x86_64 GNU/Linux
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
