so, I've incrased the SOLR_JAVA_MEM by 8 times. That memory increase is
from solr status command. But, no luck. the Indexing process using
full-import with Clean and Commit option says:
*Indexing completed. Added/Updated: 915000 documents. Deleted 0 documents.
(Duration: 20s)*
The solr count query says, 5000 rows. How to get the rest of the 915000
indexed?
{
"responseHeader":{
"status":0,
"QTime":0,
"params":{
"q":"*:*",
"indent":"true",
"q.op":"OR",
"rows":"0",
"_":"1701894264264"}},
"response":{"numFound":5000,"start":0,"numFoundExact":true,"docs":[]
}}
the solr_gc.log says these:
[2023-12-06T15:17:50.106-0500][0.012s] Heap region size: 4M
[2023-12-06T15:17:50.132-0500][0.047s] Using G1
[2023-12-06T15:17:50.132-0500][0.047s] Heap address:
0x0000000600000000, size: 8192 MB, Compressed Oops mode: Zero based,
Oop shift amount: 3
[2023-12-06T15:17:51.119-0500][1.034s] GC(0) Pause Young (Concurrent
Start) (Metadata GC Threshold)
[2023-12-06T15:17:51.119-0500][1.034s] GC(0) Using 15 workers of 15
for evacuation
[2023-12-06T15:17:51.134-0500][1.042s] GC(0) Pre Evacuate Collection
Set: 0.0ms
[2023-12-06T15:17:51.134-0500][1.042s] GC(0) Evacuate Collection Set: 6.8ms
[2023-12-06T15:17:51.134-0500][1.042s] GC(0) Post Evacuate
Collection Set: 0.7ms
[2023-12-06T15:17:51.134-0500][1.042s] GC(0) Other: 0.6ms
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Eden regions: 17->0(98)
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Survivor regions: 0->4(13)
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Old regions: 0->0
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Humongous regions: 0->0
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Metaspace: 20679K->20679K(1069056K)
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) Pause Young (Concurrent
Start) (Metadata GC Threshold) 64M->14M(8192M) 10.371ms
[2023-12-06T15:17:51.134-0500][1.044s] GC(0) User=0.22s Sys=0.00s Real=0.02s
[2023-12-06T15:17:51.134-0500][1.044s] GC(1) Concurrent Cycle
[2023-12-06T15:17:51.134-0500][1.044s] GC(1) Concurrent Clear Claimed Marks
[2023-12-06T15:17:51.134-0500][1.044s] GC(1) Concurrent Clear Claimed
Marks 0.019ms
[2023-12-06T15:17:51.134-0500][1.044s] GC(1) Concurrent Scan Root Regions
[2023-12-06T15:17:51.134-0500][1.046s] GC(1) Concurrent Scan Root
Regions 1.610ms
[2023-12-06T15:17:51.134-0500][1.046s] GC(1) Concurrent Mark (1.046s)
[2023-12-06T15:17:51.134-0500][1.046s] GC(1) Concurrent Mark From Roots
[2023-12-06T15:17:51.134-0500][1.046s] GC(1) Using 4 workers of 4 for marking
[2023-12-06T15:17:51.134-0500][1.048s] GC(1) Concurrent Mark From Roots 1.961ms
[2023-12-06T15:17:51.134-0500][1.048s] GC(1) Concurrent Preclean
[2023-12-06T15:17:51.134-0500][1.048s] GC(1) Concurrent Preclean 0.091ms
[2023-12-06T15:17:51.134-0500][1.048s] GC(1) Concurrent Mark (1.046s,
1.048s) 2.129ms
[2023-12-06T15:17:51.134-0500][1.048s] GC(1) Pause Remark
[2023-12-06T15:17:51.134-0500][1.049s] GC(1) Cleaned string and symbol
table, strings: 10128 processed, 0 removed, symbols: 62420 processed,
29 removed
[2023-12-06T15:17:51.134-0500][1.049s] GC(1) Pause Remark
18M->18M(8192M) 0.857ms
[2023-12-06T15:17:51.134-0500][1.049s] GC(1) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:17:51.134-0500][1.049s] GC(1) Concurrent Rebuild Remembered Sets
[2023-12-06T15:17:51.134-0500][1.049s] GC(1) Concurrent Rebuild
Remembered Sets 0.190ms
[2023-12-06T15:17:51.134-0500][1.050s] GC(1) Pause Cleanup
[2023-12-06T15:17:51.134-0500][1.050s] GC(1) Pause Cleanup
18M->18M(8192M) 0.107ms
[2023-12-06T15:17:51.134-0500][1.050s] GC(1) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:17:51.134-0500][1.050s] GC(1) Concurrent Cleanup for Next Mark
[2023-12-06T15:17:51.134-0500][1.054s] GC(1) Concurrent Cleanup for
Next Mark 4.341ms
[2023-12-06T15:17:51.134-0500][1.054s] GC(1) Concurrent Cycle 9.947ms
[2023-12-06T15:17:52.361-0500][2.281s] GC(2) Pause Young (Concurrent
Start) (Metadata GC Threshold)
[2023-12-06T15:17:52.361-0500][2.281s] GC(2) Using 15 workers of 15
for evacuation
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Pre Evacuate Collection
Set: 0.0ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Evacuate Collection Set: 8.6ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Post Evacuate
Collection Set: 1.3ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Other: 0.2ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Eden regions: 41->0(95)
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Survivor regions: 4->7(13)
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Old regions: 0->0
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Humongous regions: 0->0
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Metaspace: 35110K->35110K(1081344K)
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) Pause Young (Concurrent
Start) (Metadata GC Threshold) 178M->25M(8192M) 10.315ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(2) User=0.06s Sys=0.03s Real=0.01s
[2023-12-06T15:17:52.376-0500][2.291s] GC(3) Concurrent Cycle
[2023-12-06T15:17:52.376-0500][2.291s] GC(3) Concurrent Clear Claimed Marks
[2023-12-06T15:17:52.376-0500][2.291s] GC(3) Concurrent Clear Claimed
Marks 0.033ms
[2023-12-06T15:17:52.376-0500][2.291s] GC(3) Concurrent Scan Root Regions
[2023-12-06T15:17:52.376-0500][2.293s] GC(3) Concurrent Scan Root
Regions 1.781ms
[2023-12-06T15:17:52.376-0500][2.293s] GC(3) Concurrent Mark (2.293s)
[2023-12-06T15:17:52.376-0500][2.293s] GC(3) Concurrent Mark From Roots
[2023-12-06T15:17:52.376-0500][2.293s] GC(3) Using 4 workers of 4 for marking
[2023-12-06T15:17:52.376-0500][2.296s] GC(3) Concurrent Mark From Roots 2.782ms
[2023-12-06T15:17:52.376-0500][2.296s] GC(3) Concurrent Preclean
[2023-12-06T15:17:52.376-0500][2.296s] GC(3) Concurrent Preclean 0.078ms
[2023-12-06T15:17:52.376-0500][2.296s] GC(3) Concurrent Mark (2.293s,
2.296s) 2.915ms
[2023-12-06T15:17:52.376-0500][2.296s] GC(3) Pause Remark
[2023-12-06T15:17:52.376-0500][2.297s] GC(3) Cleaned string and symbol
table, strings: 15734 processed, 0 removed, symbols: 110518 processed,
48 removed
[2023-12-06T15:17:52.376-0500][2.297s] GC(3) Pause Remark
29M->29M(8192M) 1.060ms
[2023-12-06T15:17:52.376-0500][2.297s] GC(3) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:17:52.376-0500][2.297s] GC(3) Concurrent Rebuild Remembered Sets
[2023-12-06T15:17:52.376-0500][2.297s] GC(3) Concurrent Rebuild
Remembered Sets 0.300ms
[2023-12-06T15:17:52.376-0500][2.298s] GC(3) Pause Cleanup
[2023-12-06T15:17:52.376-0500][2.298s] GC(3) Pause Cleanup
29M->29M(8192M) 0.082ms
[2023-12-06T15:17:52.376-0500][2.298s] GC(3) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:17:52.376-0500][2.298s] GC(3) Concurrent Cleanup for Next Mark
[2023-12-06T15:17:52.392-0500][2.301s] GC(3) Concurrent Cleanup for
Next Mark 3.149ms
[2023-12-06T15:17:52.392-0500][2.301s] GC(3) Concurrent Cycle 9.980ms
[2023-12-06T15:17:54.272-0500][4.191s] GC(4) Pause Young (Normal) (G1
Evacuation Pause)
[2023-12-06T15:17:54.272-0500][4.191s] GC(4) Using 15 workers of 15
for evacuation
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Pre Evacuate Collection
Set: 0.0ms
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Evacuate Collection Set: 11.3ms
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Post Evacuate
Collection Set: 1.5ms
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Other: 0.2ms
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Eden regions: 95->0(90)
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Survivor regions: 7->12(13)
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Old regions: 0->0
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Humongous regions: 0->0
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Metaspace: 53343K->53343K(1097728K)
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) Pause Young (Normal) (G1
Evacuation Pause) 405M->45M(8192M) 13.409ms
[2023-12-06T15:17:54.286-0500][4.204s] GC(4) User=0.06s Sys=0.05s Real=0.01s
[2023-12-06T15:22:19.716-0500][269.623s] GC(5) Pause Young (Concurrent
Start) (Metadata GC Threshold)
[2023-12-06T15:22:19.716-0500][269.623s] GC(5) Using 15 workers of 15
for evacuation
[2023-12-06T15:22:19.767-0500][269.675s] GC(5) Pre Evacuate
Collection Set: 0.1ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Evacuate Collection Set: 49.8ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Post Evacuate
Collection Set: 1.2ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Other: 0.4ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Eden regions: 78->0(89)
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Survivor regions: 12->13(13)
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Old regions: 0->7
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Humongous regions: 1->1
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Metaspace:
58634K->58634K(1101824K)
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) Pause Young (Concurrent
Start) (Metadata GC Threshold) 360M->83M(8192M) 51.727ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(5) User=0.16s Sys=0.06s Real=0.05s
[2023-12-06T15:22:19.768-0500][269.675s] GC(6) Concurrent Cycle
[2023-12-06T15:22:19.768-0500][269.675s] GC(6) Concurrent Clear Claimed Marks
[2023-12-06T15:22:19.768-0500][269.675s] GC(6) Concurrent Clear
Claimed Marks 0.096ms
[2023-12-06T15:22:19.768-0500][269.675s] GC(6) Concurrent Scan Root Regions
[2023-12-06T15:22:19.774-0500][269.681s] GC(6) Concurrent Scan Root
Regions 5.973ms
[2023-12-06T15:22:19.774-0500][269.681s] GC(6) Concurrent Mark (269.681s)
[2023-12-06T15:22:19.774-0500][269.681s] GC(6) Concurrent Mark From Roots
[2023-12-06T15:22:19.774-0500][269.681s] GC(6) Using 4 workers of 4 for marking
[2023-12-06T15:22:19.785-0500][269.692s] GC(6) Concurrent Mark From
Roots 11.003ms
[2023-12-06T15:22:19.785-0500][269.693s] GC(6) Concurrent Preclean
[2023-12-06T15:22:19.785-0500][269.693s] GC(6) Concurrent Preclean 0.155ms
[2023-12-06T15:22:19.785-0500][269.693s] GC(6) Concurrent Mark
(269.681s, 269.693s) 11.282ms
[2023-12-06T15:22:19.785-0500][269.693s] GC(6) Pause Remark
[2023-12-06T15:22:19.790-0500][269.698s] GC(6) Cleaned string and
symbol table, strings: 33326 processed, 0 removed, symbols: 168206
processed, 723 removed
[2023-12-06T15:22:19.791-0500][269.698s] GC(6) Pause Remark
86M->86M(8192M) 5.372ms
[2023-12-06T15:22:19.791-0500][269.698s] GC(6) User=0.05s Sys=0.02s Real=0.01s
[2023-12-06T15:22:19.791-0500][269.698s] GC(6) Concurrent Rebuild
Remembered Sets
[2023-12-06T15:22:19.796-0500][269.704s] GC(6) Concurrent Rebuild
Remembered Sets 5.249ms
[2023-12-06T15:22:19.796-0500][269.704s] GC(6) Pause Cleanup
[2023-12-06T15:22:19.797-0500][269.704s] GC(6) Pause Cleanup
86M->86M(8192M) 0.620ms
[2023-12-06T15:22:19.797-0500][269.704s] GC(6) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:22:19.797-0500][269.705s] GC(6) Concurrent Cleanup for Next Mark
[2023-12-06T15:22:19.803-0500][269.710s] GC(6) Concurrent Cleanup for
Next Mark 5.585ms
[2023-12-06T15:22:19.803-0500][269.710s] GC(6) Concurrent Cycle 34.946ms
[2023-12-06T15:23:01.472-0500][311.391s] GC(7) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:23:01.472-0500][311.391s] GC(7) Using 15 workers of 15
for evacuation
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Evacuate Collection Set: 14.6ms
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Post Evacuate
Collection Set: 0.8ms
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Other: 0.2ms
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Eden regions: 89->0(97)
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Survivor regions: 13->5(13)
[2023-12-06T15:23:01.488-0500][311.406s] GC(7) Old regions: 7->20
[2023-12-06T15:23:01.488-0500][311.407s] GC(7) Humongous regions: 1->1
[2023-12-06T15:23:01.488-0500][311.407s] GC(7) Metaspace:
62409K->62409K(1105920K)
[2023-12-06T15:23:01.488-0500][311.407s] GC(7) Pause Young (Normal)
(G1 Evacuation Pause) 439M->98M(8192M) 15.837ms
[2023-12-06T15:23:01.488-0500][311.407s] GC(7) User=0.11s Sys=0.02s Real=0.02s
[2023-12-06T15:23:02.175-0500][312.086s] GC(8) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:23:02.175-0500][312.086s] GC(8) Using 15 workers of 15
for evacuation
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Evacuate Collection Set: 2.6ms
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Post Evacuate
Collection Set: 0.6ms
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Other: 0.2ms
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Eden regions: 97->0(168)
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Survivor regions: 5->7(13)
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Old regions: 20->20
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Humongous regions: 1->1
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Metaspace:
62459K->62459K(1105920K)
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) Pause Young (Normal)
(G1 Evacuation Pause) 486M->107M(8192M) 3.651ms
[2023-12-06T15:23:02.175-0500][312.090s] GC(8) User=0.00s Sys=0.00s Real=0.00s
[2023-12-06T15:23:03.377-0500][313.300s] GC(9) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:23:03.377-0500][313.300s] GC(9) Using 15 workers of 15
for evacuation
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Evacuate Collection Set: 7.5ms
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Post Evacuate
Collection Set: 0.7ms
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Other: 0.2ms
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Eden regions: 168->0(409)
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Survivor regions: 7->10(22)
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Old regions: 20->20
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Humongous regions: 5->5
[2023-12-06T15:23:03.393-0500][313.308s] GC(9) Metaspace:
62488K->62488K(1105920K)
[2023-12-06T15:23:03.393-0500][313.309s] GC(9) Pause Young (Normal)
(G1 Evacuation Pause) 795M->135M(8192M) 8.645ms
[2023-12-06T15:23:03.393-0500][313.309s] GC(9) User=0.11s Sys=0.02s Real=0.02s
[2023-12-06T15:23:06.400-0500][316.311s] GC(10) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:23:06.400-0500][316.311s] GC(10) Using 15 workers of 15
for evacuation
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Evacuate Collection
Set: 13.4ms
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Post Evacuate
Collection Set: 0.8ms
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Other: 0.3ms
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Eden regions: 409->0(415)
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Survivor regions: 10->22(53)
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Old regions: 20->20
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Humongous regions: 13->9
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Metaspace:
62492K->62492K(1105920K)
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) Pause Young (Normal)
(G1 Evacuation Pause) 1803M->198M(8192M) 14.647ms
[2023-12-06T15:23:06.416-0500][316.325s] GC(10) User=0.11s Sys=0.02s Real=0.02s
[2023-12-06T15:23:12.186-0500][322.099s] GC(11) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:23:12.186-0500][322.099s] GC(11) Using 15 workers of 15
for evacuation
[2023-12-06T15:23:12.194-0500][322.104s] GC(11) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:23:12.194-0500][322.104s] GC(11) Evacuate Collection Set: 4.0ms
[2023-12-06T15:23:12.194-0500][322.104s] GC(11) Post Evacuate
Collection Set: 0.8ms
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Other: 0.2ms
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Eden regions: 415->0(1220)
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Survivor regions: 22->8(55)
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Old regions: 20->20
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Humongous regions: 9->1
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Metaspace:
63800K->63800K(1107968K)
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) Pause Young (Normal)
(G1 Evacuation Pause) 1858M->109M(8192M) 5.204ms
[2023-12-06T15:23:12.194-0500][322.105s] GC(11) User=0.00s Sys=0.00s Real=0.01s
[2023-12-06T15:29:25.357-0500][695.278s] GC(12) Pause Young (Normal)
(G1 Evacuation Pause)
[2023-12-06T15:29:25.357-0500][695.278s] GC(12) Using 15 workers of 15
for evacuation
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Pre Evacuate
Collection Set: 0.0ms
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Evacuate Collection Set: 6.6ms
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Post Evacuate
Collection Set: 1.2ms
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Other: 0.4ms
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Eden regions: 1220->0(1227)
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Survivor regions: 8->1(154)
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Old regions: 20->20
[2023-12-06T15:29:25.364-0500][695.286s] GC(12) Humongous regions: 13->1
[2023-12-06T15:29:25.364-0500][695.287s] GC(12) Metaspace:
64809K->64809K(1107968K)
[2023-12-06T15:29:25.364-0500][695.287s] GC(12) Pause Young (Normal)
(G1 Evacuation Pause) 5037M->84M(8192M) 8.522ms
[2023-12-06T15:29:25.364-0500][695.287s] GC(12) User=0.00s Sys=0.00s Real=0.01s
On Wed, Dec 6, 2023 at 2:51 PM Vince McMahon <sippingonesandze...@gmail.com>
wrote:
> Gus, that is possible. How best to fix it?
>
> On Wed, Dec 6, 2023 at 12:05 PM Gus Heck <gus.h...@gmail.com> wrote:
>
>> Looks like your client crashed out while trying to receive the response
>> perhaps?
>>
>> Caused by: java.io.IOException: An established connection was aborted
>> by the software in your host machine
>> at sun.nio.ch.SocketDispatcher.writev0(Native Method) ~[?:?]
>> at sun.nio.ch.SocketDispatcher.writev(Unknown Source) ~[?:?]
>> at sun.nio.ch.IOUtil.write(Unknown Source) ~[?:?]
>> at sun.nio.ch.IOUtil.write(Unknown Source) ~[?:?]
>> at sun.nio.ch.SocketChannelImpl.write(Unknown Source) ~[?:?]
>> at java.nio.channels.SocketChannel.write(Unknown Source) ~[?:?]
>> at org.eclipse.jetty.io
>> .ChannelEndPoint.flush(ChannelEndPoint.java:273)
>> ~[jetty-io-9.4.44.v20210927.jar:9.4.44.v20210927]
>> at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)
>> ~[jetty-io-9.4.44.v20210927.jar:9.4.44.v20210927]
>>
>> On Wed, Dec 6, 2023 at 11:29 AM Vince McMahon <
>> sippingonesandze...@gmail.com>
>> wrote:
>>
>> > Thanks for the suggestion.
>> >
>> > 10 rows work for full-Import and Solr count query confirm 10 imported.
>> :)
>> >
>> > I've tried with debug=false and no improvement on larger number of
>> > rows, such as 755000. I reduced the source side from 1 million rows to
>> > just 755000 to test volume; borrowing the idea of "10 rows". :)
>> >
>> > BTW, is there a place to specify the BatchSize for full-import?
>> > full-import doesn't seem to do 20,000 at a time regardless of the
>> batchSize
>> > specified in JDBC driver.
>> >
>> > The /dataimport in solrconfig.xml block is
>> >
>> > <requestDispatcher>
>> > <httpCaching never304="true" />
>> > </requestDispatcher>
>> > * <requestHandler name="/dataimport" class="solr.DataImportHandler">*
>> > * <lst name="defaults">*
>> > * <str name="config">db-data-config.xml</str>*
>> > * </lst>*
>> > * </requestHandler>*
>> > <requestHandler name="/select" class="solr.SearchHandler">
>> > <lst name="defaults">
>> > <str name="echoParams">explicit</str>
>> > <int name="rows">10</int>
>> > </lst>
>> > </requestHandler>
>> > <requestHandler name="/query" class="solr.SearchHandler">
>> > <lst name="defaults">
>> > <str name="echoParams">explicit</str>
>> > <str name="wt">json</str>
>> > <str name="indent">true</str>
>> > </lst>
>> > </requestHandler>
>> >
>> >
>> > >
>> >
>>
>>
>> --
>> http://www.needhamsoftware.com (work)
>> https://a.co/d/b2sZLD9 (my fantasy fiction book)
>>
>
