We are using datstax java driver 1.5.0
Thank you.
On Saturday, 12 May 2018, 10:37:04 GMT-7, Jeff Jirsa <[email protected]>
wrote:
I haven't seen this before, but I have a guess.
What client/driver are you using?
Are you using a prepared statement that has every column listed for the update,
and leaving the un-set columns as null? If so, the null is being translated
into a delete, which is clearly not what you want.
The differentiation between UNSET and NULL went into 2.2 (
https://issues.apache.org/jira/browse/CASSANDRA-7304 ) , and most drivers have
been updated to know the difference ( https://github.com/gocql/gocql/issues/861
, https://datastax-oss.atlassian.net/browse/JAVA-777 , etc). I haven't read the
patch for 7304, but I suspect that maybe there's some sort of mixup along the
way (maybe in your driver, or maybe you upgraded the driver to support 3.0 and
picked up a new feature you didnt realize you picked up, etc)
On Fri, May 11, 2018 at 11:26 AM, kooljava2 <[email protected]> wrote:
After further analyzing the data. I see some pattern. The rows which were
updated in last 2-3 weeks, the column which were not part of this update have
the null values.
Has anyone encountered this issue during the upgrade?
Thank you,
On Thursday, 10 May 2018, 19:49:50 GMT-7, kooljava2
<[email protected]> wrote:
Hello Jeff,
2.1.19 to 3.0.15.
Thank you.
On Thursday, 10 May 2018, 17:43:58 GMT-7, Jeff Jirsa <[email protected]>
wrote:
Which minor version of 3.0
-- Jeff Jirsa
On May 11, 2018, at 2:54 AM, kooljava2 <[email protected]> wrote:
Hello,
Upgraded Cassandra 2.1 to 3.0. We see certain data in few columns being set to
"null". These null columns were created during the row creation time.
After looking at the data see a pattern where update was done on these rows.
Rows which were updated has data but rows which were not part of the update are
set to null.
created_on | created_by | id
------------------------------ ---+---------------------+----
------------------------------ -------
null | null |
12345
sstabledump:-
WARN 20:47:38,741 Small cdc volume detected at /var/lib/cassandra/cdc_raw;
setting cdc_total_space_in_mb to 1278. You can override this in cassandra.yaml
[
{
"partition" : {
"key" : [ "12345" ],
"position" : 5155159
},
"rows" : [
{
"type" : "row",
"position" : 5168738,
"deletion_info" : { "marked_deleted" : "2018-03-28T20:38:08.059999Z",
"local_delete_time" : "2018-03-28T20:38:08Z" },
"cells" : [
{ "name" : "doc_type", "value" : false, "tstamp" :
"2018-03-28T20:38:08.060Z" },
{ "name" : "industry", "deletion_info" : { "local_delete_time" :
"2018-03-28T20:38:08Z" },
"tstamp" : "2018-03-28T20:38:08.060Z"
},
{ "name" : "last_modified_by", "value" : "12345", "tstamp" :
"2018-03-28T20:38:08.060Z" },
{ "name" : "last_modified_date", "value" : "2018-03-28
20:38:08.059Z", "tstamp" : "2018-03-28T20:38:08.060Z" },
{ "name" : "locale", "deletion_info" : { "local_delete_time" :
"2018-03-28T20:38:08Z" },
"tstamp" : "2018-03-28T20:38:08.060Z"
},
{ "name" : "postal_code", "deletion_info" : { "local_delete_time" :
"2018-03-28T20:38:08Z" },
"tstamp" : "2018-03-28T20:38:08.060Z"
},
{ "name" : "ticket", "deletion_info" : { "marked_deleted" :
"2018-03-28T20:38:08.059999Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
{ "name" : "ticket", "path" : [ "TEMP_DATA" ], "value" :
"{\"name\":\"TEMP_DATA\",\" ticket\":\" a42638dae8350e889f2603be1427ac
6f5dec5e486d4db164a76bf80820cd f68d635cff5e7d555e6d4eabb9b5b8
2597b68bec0fcd735fcca\",\" lastRenewedDate\":\"2018-03- 28T20:38:08Z\"}",
"tstamp" : "2018-03-28T20:38:08.060Z" },
{ "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" :
"{\"name\":\"TEMP_TEMP2\",\" ticket\":\"a4263b7350d1f2683\"
,\"lastRenewedDate\":\"2018- 03-28T20:38:07Z\"}", "tstamp" :
"2018-03-28T20:38:08.060Z" },
{ "name" : "ppstatus_pf", "deletion_info" : { "marked_deleted" :
"2018-03-28T20:38:08.059999Z", "local_delete_time" : "2018-03-28T20:38:08Z" } },
{ "name" : "ppstatus_pers", "deletion_info" : { "marked_deleted" :
"2018-03-28T20:38:08.059999Z", "local_delete_time" : "2018-03-28T20:38:08Z" } }
]
}
]
}
]WARN 20:47:41,325 Small cdc volume detected at /var/lib/cassandra/cdc_raw;
setting cdc_total_space_in_mb to 1278. You can override this in cassandra.yaml
[
{
"partition" : {
"key" : [ "12345" ],
"position" : 18743072
},
"rows" : [
{
"type" : "row",
"position" : 18751808,
"liveness_info" : { "tstamp" : "2017-10-25T10:22:41.612Z" },
"cells" : [
{ "name" : "created_by", "value" : "12345" },
{ "name" : "created_on", "value" : "2017-10-25 10:22:41.637Z" },
{ "name" : "doc_type", "value" : false, "tstamp" :
"2017-10-25T10:22:42.487Z" },
{ "name" : "last_modified_by", "value" : "12345", "tstamp" :
"2017-10-25T10:22:42.487Z" },
{ "name" : "last_modified_date", "value" : "2017-11-10
00:09:52.668Z", "tstamp" : "2017-11-10T00:09:52.668Z" },
{ "name" : "per_type", "value" : "user" },
{ "name" : "lists", "path" : [ "cn.cncn.bpnp" ], "value" :
"[\"::accid:ab\",\"::accid:e1\ ",\"::accid:d2\",\"::accid:d3\
",\"::accid:f3\",\"::accid:g3\ ",\"::accid:f4\",\"::accid:
9c486ae5-00b2-3c63-af70- cff2950c4181\"]", "tstamp" :
"2017-10-25T10:22:42.782Z" },
{ "name" : "ticket", "path" : [ "TEMP_TEMP2" ], "value" :
"{\"name\":\"TEMP_TEMP2\",\" ticket\":\" a4263820be49c3a222e0248532bcef
c80c773194a804057561a97382e595 b51f36bb46b8675589fc89dea4a5c0
ceb944d63861b39d63c0067161e84c 79328077c650df33530c7625857444
711dc4b1051638123694ba6e9e29b1 f906663f3\",\"lastRenewedDate\
":\"2017-11-10T00:09:52Z\"}", "tstamp" : "2017-11-10T00:09:52.668Z" }
]
}
]
}
]
