Re: How to index a csv dataset into Solr using SolrJ

2023-01-30 Thread Jan Høydahl
It's not a common use case for SolrJ to post plain CSV content to Solr. SolrJ 
is used to push SolrInputDocument objects. Maybe there's a way to do it by 
using some Generic request type and overriding content type.. Can you explain 
more what you app will do, where that CSV file comes from in the first place 
and why you'd want to use SolrJ to move it to Solr, rather than curl or some 
other http client lib?

Jan

> 29. jan. 2023 kl. 20:44 skrev marc nicole :
> 
> The Java code should perform the post. Any piece of code to show to better
> explain this?
> 
> thanks
> 
> Le dim. 29 janv. 2023 à 20:29, Jan Høydahl  a écrit :
> 
>> Read csv in your app, create a Solr doc from each line and ingest to Solr
>> in fitting batches. You can use a csv library or just parse each line
>> yourself if the format is fixed.
>> 
>> If you need to post csv directly to Solr you’d use a plain http post with
>> content-type csv, but in most cases your app would do that.
>> 
>> Jan Høydahl
>> 
>>> 29. jan. 2023 kl. 20:21 skrev marc nicole :
>>> 
>>> Hi guys,
>>> 
>>> I can't find a reference on how to index a dataset.csv file into Solr
>> using
>>> SolrJ.
>>> https://solr.apache.org/guide/6_6/using-solrj.html
>>> 
>>> Thanks.
>> 



Vulnerabilities detected by AWS inspector scan for v8.11.2-r0

2023-01-30 Thread Ng Pei Shan
Hi there,

We are using Solr container image for our application. AWS Inspector Scan has 
reflected some vulnerabilities on the libraries.
May I know if this is the correct channel to seek help in the resolution of the 
below vulnerabilities?

Container image used: 8.11.2-r0
Platform: Debian 11

Below are the vulnerabilities reflected:
CVE-2022-25168 - 
org.apache.hadoop:hadoop-common
CVE-2022-26612 - 
org.apache.hadoop:hadoop-common
CVE-2021-37404 - 
org.apache.hadoop:hadoop-common
CVE-2020-10650 - 
com.fasterxml.jackson.core:jackson-databind

Affected library:
hadoop-common-3.2.2.jar
htrace-core4-4.1.0-incubating.jar

Best Regards,
[cid:image001.png@01D9351A.0FDACE40]
  Ng Pei Shan,
  Project Manager

  Websparks Pte Ltd
  61 Kaki Bukit Avenue 1, Shun Li Industrial Park #04-08 Singapore 417943
  (O): +65 6292-4654   (M) +65 9710-2851
  http://www.websparks.sg | * - Adding the sparkles 
to your web presence! - *





"This email is confidential and may be privileged. If you are not the intended 
recipient, please delete it and notify us immediately; you should not copy or 
use it for any purpose, nor disclose its contents to any other person. Thank 
you."



"This email is confidential and may be privileged. If you are not the intended 
recipient, please delete it and notify us immediately; you should not copy or 
use it for any purpose, nor disclose its contents to any other person. Thank 
you."


Re: Vulnerabilities detected by AWS inspector scan for v8.11.2-r0

2023-01-30 Thread Kevin Watters
Hi Ng,
  We maintain a custom build of solr that fixes all of those (and many
more) on the 8.11.x branch.  Let me know if you're interested and if so
perhaps we can set up a time to chat about it.
Best Regards,
  -Kevin Watters
   KMW Technology

On Mon, Jan 30, 2023 at 2:26 PM Ng Pei Shan  wrote:

> Hi there,
>
> We are using Solr container image for our application. AWS Inspector Scan
> has reflected some vulnerabilities on the libraries.
> May I know if this is the correct channel to seek help in the resolution
> of the below vulnerabilities?
>
> Container image used: 8.11.2-r0
> Platform: Debian 11
>
> Below are the vulnerabilities reflected:
> CVE-2022-25168  -
> org.apache.hadoop:hadoop-common
> CVE-2022-26612  -
> org.apache.hadoop:hadoop-common
> CVE-2021-37404  -
> org.apache.hadoop:hadoop-common
> CVE-2020-10650  -
> com.fasterxml.jackson.core:jackson-databind
>
> Affected library:
> hadoop-common-3.2.2.jar
> htrace-core4-4.1.0-incubating.jar
>
> Best Regards,
>
> 
>
>   *Ng Pei Shan,*
>   Project Manager
>
>   *Websparks Pte Ltd*
>   61 Kaki Bukit Avenue 1, Shun Li Industrial Park #04-08 Singapore 417943
>   (O): +65 6292-4654   (M) +65 9710-2851
>   http://www.websparks.sg | * - Adding the sparkles to your web presence!
> - *
>
>
>
>
> --
>
>
>
>
>
> "This email is confidential and may be privileged. If you are not the
> intended recipient, please delete it and notify us immediately; you should
> not copy or use it for any purpose, nor disclose its contents to any other
> person. Thank you."
>
>
> --
>
> "This email is confidential and may be privileged. If you are not the
> intended recipient, please delete it and notify us immediately; you should
> not copy or use it for any purpose, nor disclose its contents to any other
> person. Thank you."
>


Migrating from solrcloud to containerized solr

2023-01-30 Thread Anchal Sharma2
Hi All ,

We are currently using SolrCloud version 9.0.0 along with zookeeper version 
3.5.8(in cluster form with 3 zookeepers and 2 solr). We are attempting to 
containerize our solr and move all our current collections and data to the new 
containers.
Is there any existing documentation or guidelines that we can follow to 
migrate. And any things/limitations we should look out for?

Any help/suggestions would be highly appreciated.

Thank You
Anchal Sharma




JWT Authorization not working in solr-9.0.0

2023-01-30 Thread Vinay Kumar
HI All,

Recently we migrated from solr 8 to Solr 9 , in SOLR 8 we did not face any
issue using SOLR JWT Authorization , but in Solr 9 we are seeing the below
error, after going through the document it is saying to enable the JWT
module , could you please help how to enable the JWT module in solr.in.sh

ERROR - 2023-01-31 01:10:12.871; [   ]
org.apache.solr.common.cloud.ZkStateReader$2; Error running collections
node listener
org.apache.solr.common.SolrException: * Error loading class
'solr.JWTAuthPlugin'*
at
org.apache.solr.core.SolrResourceLoader.findClass(SolrResourceLoader.java:543)
~[solr-core-9.0.0.jar:9.0.0 a4eb7aa123dc53f8dac74d80b66a490f2d6b4a26 -
janhoy - 2022-05-05 01:00:08]
at
org.apache.solr.core.SolrResourceLoader.newInstance(SolrResourceLoader.java:604)
~[solr-core-9.0.0.jar:9.0.0 a4eb7aa123dc53f8dac74d80b66a490f2d6b4a26 -
janhoy - 2022-05-05 01:00:08]


could you please help me to enable solr module for *solr.JWTAuthPlugin in
solr 9.0 *

security.json

{
"authentication": {
"class": "solr.MultiAuthPlugin",
"schemes": [{
"scheme": "bearer",
"blockUnknown": true,
"class": "solr.JWTAuthPlugin",
"wellKnownUrl": "
https://auth./ausl3dal2JfnJ2ENi4h6/.well-known/openid-configuration";,
"clientId": "0oa32rh1yhd3SoSUK4h7",
"redirectUris": ["http://hostname:8983/solr
",
"http:// hostname 8983/solr",
"http:// hostname:8983/solr",
"http:// hostname:8983/solr/admin"
],
"rolesClaim": "roles",
 "adminUiScope": "openid"
 },
{
"scheme": "basic",
"blockUnknown": true,
"class": "solr.BasicAuthPlugin",
"credentials": {
"solr":
"IV0EHq1OnNrj6gvRCwvFwTrZ1+z1oBbnQdiVC3otuq0=
Ndd7LKvVBAaZIF0QAVi1ekCfAJXr1GGfLtRUXhgrF8c="
}
}
]
}


 }