Re: nodes in the baseline topology is going to OFFLINE state

2019-10-17 Thread shivakumar
Hi Ilya Kasnacheev, Is there any other way of gracefully shutting down/restart the entire cluster? regards, shiva -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Starvation in striped pool

2019-10-17 Thread ihalilaltun
Hi Ilya, >From time to time, we have faced exactly the same problem. Is there any best practices for handling network issues? What i mean is, if there is any network issues between client/s and server/s we want the cluster keeps living. As for the clients, they can be disconnected from servers. R

Optimistic Serializable SQL Transactions

2019-10-17 Thread Justin Moore
Hi, Very new to Ignite and just trying to assess its capabilities. tl;dr: are optimistic serializable sql transactions on the roadmap? It seems that currently only pessimistic repeatable_read sql transactions are supported (in beta as of the current version -- 2.7). I'm trying to confirm that,

Re: Issue with adding nested index dynamically

2019-10-17 Thread Hemambara
ignite_bug_share.zip Thanks for the reply. Please find the attached. 1) IndextestIgniteServer1 - starts server 2) IndexTestIgniteClient1 - starts the client 3) I did not add QueryEntities - we have usecase where w

Re: Issue with adding nested index dynamically

2019-10-17 Thread Denis Magda
Please check Ivan's latest response - Denis On Thu, Oct 17, 2019 at 5:16 AM Hemambara wrote: > Hello Denis/Ivan, can you please check this and if there are no issues can > you merge the code. Sorry for the rush. We are getting ready for prod in > next 3 months and this is really important for

Re: Getting data[parquet,json,...] from S3 buckets to apache ignite

2019-10-17 Thread Denis Magda
Hi Viktor, Could you please clarify a bit, do you need just to load data once/periodically or do you want Ignite to write-back to S3 on updates? If the loading is all you need then create a custom Java app/class that pulls data from S3 and streams into Ignite IgniteDataStreamer (fastest loading te

Ingite node in SpringBoot App

2019-10-17 Thread niamin
I've created a SpringBoot App that includes code to start an Ignite standalone node and populates a cache. The logic is wrapped in a PostConstruct method on a Bean. However Ignite server stops as soon as app returns from the method to start Ignite server and populate cache. I would like to be able

Apache Spark + Ignite Connection Issue

2019-10-17 Thread sri hari kali charan Tummala
Hi Community, I am trying to read and write into the Ignite cluster using apache-spark I am able to do that using JDBC thin client but not native method as mentioned in several spark + ignite examples. Right now all the spark + ignite examples launch a local ignite cluster but I want my code conn

Re: Does any one have working Ignite cluster on AWS

2019-10-17 Thread sri hari kali charan Tummala
Hi Stephen , in your example or any spark example I only see creating local ignite node how to connect spark to ignite client which I already have? b.filter('href is not null') \ .drop('hash', 'meta') \ .write.format('ignite') \ .option('config',*'default-config.xml') \* .option('table','bookmark

Re: nodes in the baseline topology is going to OFFLINE state

2019-10-17 Thread Ilya Kasnacheev
Hello! Can you provide logs from nodes which are considered OFFLINE by cluster? Please note that it is advised to start one node and then start all other when first one is up, as opposed to starting them all at the same moment. Regards, -- Ilya Kasnacheev чт, 17 окт. 2019 г. в 17:54, shivakum

nodes in the baseline topology is going to OFFLINE state

2019-10-17 Thread shivakumar
Hi all, I have Ignite deployment on Kubernetes and I wanted to restart all nodes so I am using "kill -k" command from the visor shell. after running this command it is restarting all nodes, once all nodes join the topology sometimes few nodes are going into OFFLINE state [eventhough the nodes are u

Re: Connection Refused in Scala Ignite Client (Help!)

2019-10-17 Thread sri hari kali charan Tummala
worked like a charm, thank you. On Thu, Oct 17, 2019 at 2:54 AM Artem Budnikov wrote: > Hi, > > Looks like you are trying to connect to the wrong port. The default port > for client connection is 10800. > > Change: > > val cfg2 = new ClientConfiguration().setAddresses("100.25.173.220:47100 > ..4

Re: Ignite Node Connection Issue

2019-10-17 Thread sri hari kali charan Tummala
Thank you, worked like a charm! On Thu, Oct 17, 2019 at 5:14 AM Denis Mekhanikov wrote: > I answered to you on stackoverflow: > https://stackoverflow.com/questions/58422096/failing-to-connect-apache-ignite-cluster > You need to use the port 10800 for thin clients instead of 47xxx > > Denis > On

Re: Node stopped.

2019-10-17 Thread John Smith
Ok I have metribeat running on the VM hopefully I will see something... On Thu, 17 Oct 2019 at 05:09, Denis Mekhanikov wrote: > There are no long pauses in the GC logs, so it must be the whole VM pause. > > Denis > On 16 Oct 2019, 23:07 +0300, John Smith , wrote: > > Sorry here is the gc logs fo

Getting data[parquet,json,...] from S3 buckets to apache ignite

2019-10-17 Thread viktor
Hi, I'm currently working on r&d project where we would like to retrieve data files[parquet, json, ...] from S3 buckets and load the data into apache ignite for machine learning purposes with tensorflow. With the removal of IGFS in the next release I'm having troubles finding a solution. What wou

Re: Action performed multiple times when using HA ignite clients using continuous queries

2019-10-17 Thread Stephen Darlington
You can deploy services to client nodes, for example: val service = ignite.services(ignite.cluster().forClients()) service.deployClusterSingleton("TestService", new TestServiceImpl()) If you want to have independent clients, as you currently have, I suspect you’d have to implement your own fail ov

RE: Issue querying id column only

2019-10-17 Thread Kurt Semba
Hi Denis, The cache was defined in the spring configuration as follows and not generated through SQL DML:

Re: Issue with adding nested index dynamically

2019-10-17 Thread Hemambara
Hello Denis/Ivan, can you please check this and if there are no issues can you merge the code. Sorry for the rush. We are getting ready for prod in next 3 months and this is really important for us and we need to test all our functionality as well. It would be a great help if we have this fixed

Re: Issue with adding nested index dynamically

2019-10-17 Thread Ivan Pavlukhin
Hi Hemambara, Could you bring a little bit more details about your problem? I would like to see you java classes and QueryEntity configuration. Ideally it would be to have a runnable reproducer (junit test or class with main method). Also I would like to realize how soon are you expecting a fix i

Re: Issue with adding nested index dynamically

2019-10-17 Thread Ivan Pavlukhin
I created a gist with my code [1] as it renders not so good inline. [1] https://gist.github.com/pavlukhin/362c0e40d4a010a8f7c0795368e53efb чт, 17 окт. 2019 г. в 15:01, Ivan Pavlukhin : > > Hi Hemambara, > > Could you bring a little bit more details about your problem? > I would like to see you ja

Re: Action performed multiple times when using HA ignite clients using continuous queries

2019-10-17 Thread Ilya Kasnacheev
Hello! You can use distributed locks to make sure only one client is working on a chunk of data. Regards, -- Ilya Kasnacheev чт, 17 окт. 2019 г. в 12:37, SunSatION : > I don't wish to deploy the client code onto each and every server as we > would like to keep the separation between business

Re: Authenticating communication between nodes using Ignite.Net

2019-10-17 Thread Ilya Kasnacheev
Hello! It's hard to say why this may be. Maybe your client can't find one of key files by specified path? If you have a reproducer project which you can share, I could look into it. I can ever take my own keys from Ignite tests, so you don't have to share these. Regards, -- Ilya Kasnacheev ср

Re: Does any one have working Ignite cluster on AWS

2019-10-17 Thread Stephen Darlington
You have to tell it where to connect: ./sqlline -u jdbc:ignite:thin://127.0.0.1/ I also wrote this showing a few ways to load data without firing up an IDE: https://medium.com/@sdarlington/loading-data-into-apache-ignite-c0cb7c065a7

Re: Striim support for Ignite

2019-10-17 Thread Denis Mekhanikov
I’m not aware of any activity towards supporting Striim. Try asking the same in the Striim community. Hopefully, somebody will help you with that there. Denis On 16 Oct 2019, 21:51 +0300, niamin , wrote: > Is there any plan to add Ignite connector for Striim to facilitate CDC? > > > > -- > Sent f

Re: Unable to find the ml.inference package

2019-10-17 Thread Denis Mekhanikov
This package hasn’t  been released yet. It’s planned to be released in Apache Ignite 2.8. Here is the ticket under which this package was created:  https://issues.apache.org/jira/browse/IGNITE-10234 Till then you can try using a nightly build:  https://ignite.apache.org/download.cgi#nightly-build

Re: Issue querying id column only

2019-10-17 Thread Denis Mekhanikov
Are you able to reproduce this issue using SQL only? Could you share the DDL, insert and select statements that lead to the described issue? I tried the following queries, but they work as expected. CREATE TABLE people (id int PRIMARY key, first_name varchar, last_name varchar); INSERT INTO peo

Re: Action performed multiple times when using HA ignite clients using continuous queries

2019-10-17 Thread SunSatION
I don't wish to deploy the client code onto each and every server as we would like to keep the separation between business logic and data. Additionally, we are pushing the changes to Kafka and therefore not sure if it's heavy to perform the push the Service grid On Wed, Oct 16, 2019 at 6:02 PM Ste

Re: Query Parallelism through SQL

2019-10-17 Thread Evgenii Zhuravlev
Hi, When you create table using DDL, you can choose template with a cache configuration(CREATE TABLE WITH TEMPLATE): https://www.gridgain.com/docs/latest/sql-reference/ddl#create-table Inside template you can define query parallelism Evgenii чт, 17 окт. 2019 г. в 09:11, Kurt Semba : >

Re: Ignite Node Connection Issue

2019-10-17 Thread Denis Mekhanikov
I answered to you on stackoverflow:  https://stackoverflow.com/questions/58422096/failing-to-connect-apache-ignite-cluster You need to use the port 10800 for thin clients instead of 47xxx Denis On 17 Oct 2019, 00:08 +0300, sri hari kali charan Tummala , wrote: > I even tried with simple scala cod

Re: Node stopped.

2019-10-17 Thread Denis Mekhanikov
There are no long pauses in the GC logs, so it must be the whole VM pause. Denis On 16 Oct 2019, 23:07 +0300, John Smith , wrote: > Sorry here is the gc logs for all 3 machines:  > https://www.dropbox.com/s/chbbxigahd4v9di/gc-logs.zip?dl=0 > > > On Wed, 16 Oct 2019 at 15:49, John Smith wrote: > >