How many records in (1) memmory? (2) disk?

2020-03-04 Thread joseheitor
How can I check if all the data in a cache is in memory? Or only a portion of the data? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

How to configure primary data in memory and backup data on disk?

2020-02-20 Thread joseheitor
How do I configure Primary data in RAM and backup copies to disk? The goal is to store backup copies on disk, leaving max RAM available for primary partitions only. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite ML - Weka integration?

2020-02-06 Thread joseheitor
Hi, You also raise some interesting points... Weka has integrations to Hadoop and Spark via 'plugins' from their package manager. And Weka's 'sister-project', MOA is specifically intended to operate on large data streams. These products are extensive, open-source and extendible. Regarding Python

Ignite ML - Weka integration?

2020-02-03 Thread joseheitor
Hi Ignite-ML Team, I have recently discovered WEKA - a Java ML workbench and library from the University of Waikato. I have observed that Ignite-ML is developing quickly in it's computational capabilities, but is lacking a 'workbench environment' for interactive data-science workflows. Surprising

Re: How to choose Leader manually?

2020-01-29 Thread joseheitor
Hi there, Firstly let me clarify that I am just an Ignite user - not an Ignite team member/expert...so it will be great to get the views of the experts in this discussion... Now, in Ignite, all data gets 'stored' in a 'CACHE'. If you want your data to be persisted, you simply configure your desig

Re: How to choose Leader manually?

2020-01-29 Thread joseheitor
Hi, As I understand it - if you are connecting via the JDBC Thin Client, in the connection-string, you would list only the endpoints of the servers in the 'Main Purpose' datacenter. To failover to servers in the other datacenter however, you would have to change your connection string and re-esta

Machine Learning questions

2019-12-30 Thread joseheitor
Hi Guys, A few questions as I progress through my ML learning journey with Ignite... - I assume that I would start by extracting features from my JSON records in a cache into a vectorizer - how does this impact memory usage? Will origin cache records be moved to disk, as more memory is required t

Re: Ignite AI learning resources

2019-12-02 Thread joseheitor
Awesome - Thanks (have just started looking through the tutorial examples) Will look through the links to resources too. Being new to AI, it is difficult to know where to start, but am committed to Ignite for other reasons, so would like to learn by using the Ignite ML features... Looking forward

Ignite AI learning resources

2019-12-02 Thread joseheitor
Hi, Can anyone recommend some resources to learn the fundamentals of ML and DL, and how to use these techniques in practical ways with the Apache Ignite AI platform? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite 2.7.5

2019-05-13 Thread joseheitor
Hi Dimitry, Will version 2.7.5 be based on the current (2.8.0) nightly code-base? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: H2 SQL query optimiser strategy in Ignite

2019-05-08 Thread joseheitor
Hi Ignite Team, Have the system architects explored the option of maintaining table statistics on each node (as Postgres and other legacy SQL engines do), and then distributing the raw SQL query to each node and letting each node execute the query planner locally, optimising the query based on the

Segmentation Plugin blog or article?

2019-04-22 Thread joseheitor
Is there a blog or article that describes the use-cases and usage of the Segmentation Plugin: https://github.com/luqmanahmad/ignite-plugins Also, does the community have any step-by-step recommendations for managing and recovering from split-brain

Production network and backup requirements

2019-04-18 Thread joseheitor
Hi Ignite Team, - what is the recommended minimum network connection bandwidth between nodes (100M? 1G? >1G?) - what is the recommended minimum network latency between nodes (<1ms? <10ms? <100ms?) - can one use the same 'affinityBackupFilter' strategy that is recommended for distributing backup

Re: Free Network Segmentation (aka split brain problem) plugin available

2019-04-17 Thread joseheitor
Hi Luqman, Does your plugin just detect a segmentation occurrence? Or does it also resolve the split-brain condition? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: H2 SQL query optimiser strategy in Ignite

2019-02-27 Thread joseheitor
Thanks, Ilya. The reason that I am trying to better understand the rationale is that I had a multi-join query that was performing badly on Ignite compared to PostgreSQL. When comparing the query plans from the two systems, I discovered that the Postgres query-planner had re-ordered the joins in m

H2 SQL query optimiser strategy in Ignite

2019-02-27 Thread joseheitor
Hi, H2 uses a cost-based query optimisation strategy for the query-planner. But in the case of Ignite, I suspect that this cannot be leveraged because the client node does not have access to data statistics (distribution, size, etc) throughout the various client nodes... So how is the query plan

Re: Populating tables via IgniteDataStreamer

2019-02-18 Thread joseheitor
Hi Clay, With JDBC, I have used the following successfully: dbConnection = HikariCPDatasource.getConnection(); dbConnection.setSchema("public"); *dbConnection.createStatement().execute("ALTER TABLE tablename NOLOGGING");* *dbConnection.createStatement().execute("SET STREAMING ON");* f

Re: SQL table - calculating memory size?

2019-02-14 Thread joseheitor
Please help? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Capacity planning spreadsheet (RAM)

2019-02-12 Thread joseheitor
Hi, The capacity planning spreadsheet available for download from the Ignite website appears to be a very useful tool - Thanks. One question: The RAM value in the /Server Capacity (Adjusted)/ section seems to take the individual server RAM and subtract 12G (=E6-4-8). This appears to imply that

SQL table - calculating memory size?

2019-02-12 Thread joseheitor
Hi, The capacity-planning docs refer to object sizes in a single cache... how do I calculate the data size in one or more SQL tables, with multiple columns? Do I estimate and sum the data size in each column multiplied by the maximum estimated number of records? And sum these results for all tabl

[SOLVED] configure location of 'work' folder?

2019-02-10 Thread joseheitor
Found the answer in this thread: http://apache-ignite-users.70518.x6.nabble.com/Apache-Ignite-quot-work-quot-folder-for-clients-td21380.html -- Sent from: http://apache-ignite-users.

configure location of 'work' folder?

2019-02-10 Thread joseheitor
Hi, Can we configure the location of the 'work' folder? I would like to run Ignite in a Docker container, but set the location of the 'work' folder to a docker mount, which leaves the work folder accessible from outside the container... Thanks, Jose -- Sent from: http://apache-ignite-users.70

[SOLVED] Re: Which IgniteCompute function?

2019-02-04 Thread joseheitor
Got it working - precisely as you suggest. Many thanks, Max. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [BUG REPORT] JDBC Create Index

2019-02-04 Thread joseheitor
Thanks, Ilya. 1. - I see that this issue has been addressed - should I be able to verify this by pulling the latest nightly-build? 2. - Issuing the following statement via a JDBC application or with a JDBC client, such as DBeaver, results in the index being created, but only on the 2nd and 3rd sp

[BUG REPORT] JDBC Create Index

2019-02-03 Thread joseheitor
Hi Ignite Team, Here are three issues that I have picked up on a 2.8 nightly build (don't know if these have been reported and logged previously...?): Version: 2.8 Build: 20181226 *Issue 1:* CREATE INDEX statements cannot be part of an SQL multi-statement. But they can be executed individually.

Re: [RESOLVED] when JDBC query result larger than heap...?

2019-02-01 Thread joseheitor
Found the solution... 'Query Lazy Loading' ( https://apacheignite-sql.readme.io/docs/performance-and-debugging ) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

when JDBC query result larger than heap...?

2019-02-01 Thread joseheitor
How can I process a large resultset from a JDBC query, that requires more memory than is available for heap space? I have tried 'paging' with SQL 'OFFSET' and 'FETCH FIRST/NEXT ROW(S) ONLY' - but still run out of memory ...regardless of the 'paging' size. -- Sent from: http://apache-ignite-user

SQL FETCH examples?

2019-02-01 Thread joseheitor
Hi Ignite Team, Do you have any examples illustrating the use of SQL: FETCH FIRST/NEXT ROW(S) ONLY ??? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

2.8 release date?

2019-01-30 Thread joseheitor
Hi Ignite Team, When is version 2.8 expected to be released? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Which IgniteCompute function?

2019-01-25 Thread joseheitor
Thanks, Karun. >From my interpretation of the Javadocs, I also presumed that 'broadcastAsync' would probably be the most appropriate... Do you perhaps know where I might find a related Java-7 code snippet as an example usage of: IgniteFuture> broadcastAsync(IgniteClosure job, T arg) Jose

Which IgniteCompute function?

2019-01-25 Thread joseheitor
Which IgniteCompute function would be best suited to this task?... Cluster has SQL table configured in partitioned cache (records distributed over several nodes). On all nodes, I would like to asynchronously execute logic which... - SQL SELECT query for matching records on each node (retrieving

Which IgniteCompute function?

2019-01-25 Thread joseheitor
Which IgniteCompute function would be best suited to this task?... Cluster has SQL table configured in partitioned cache (records distributed over several nodes). On all nodes, I would like to asynchronously execute logic which... - SQL SELECT query for matching records on each node (retrieving

Re: CAP Theorem (CP? or AP?)

2018-12-24 Thread joseheitor
Guys, thank you both for your informative and helpful responses. I have explicitly configured the cache-template with the additional property: And have observed the following behaviour: 1. [OK] Attempting to get a specific record(s) which resides in a lost partition does indeed return an excep

CAP Theorem (CP? or AP?)

2018-12-23 Thread joseheitor
In this GridGain presentation: https://www.youtube.com/watch?v=u8BFLDfOdy8&t=1806s Valentin Kulichenko explains the CAP theorem and states that Apache Ignite is designed to favour Strong-Consistency (CP) over High-Availability (AP). However

[RESOLVED] Cluster High-Availability

2018-12-23 Thread joseheitor
Okay - I found the answer to my Exception problem in the following post: http://apache-ignite-users.70518.x6.nabble.com/Default-Cache-template-tp19494p19497.html -- Sent from: http://apache-ignite-user

Re: Cluster High-Availability

2018-12-22 Thread joseheitor
Denis, This is exactly what I am looking for - Thanks. I am getting an error though, when attempting to create a table with my defined cache-template. Please check my config below and kindly let me know what I am missing...? NODE CONFIG: ...

Re: Optimizing Collocated Join

2018-12-18 Thread joseheitor
Try this: SELECT subQuery.coveringId, COUNT(*) FROM ( SELECT innerS2.* FROM S2CellCovering AS innerS2 INNER JOIN EventTheta AS innerEvent ON innerEvent.parentS2CellId = innerS2.parentS2CellId AND innerEvent.s2CellId BETWEEN innerS2.minS2Cell

Re: Cluster High-Availability

2018-12-11 Thread joseheitor
Thanks for the response, Denis. I am afraid that I don't really understand how to leverage the feature you indicated, purely from the Javadocs... Can you provide a simple set of node-configs, that would illustrate and accomplish what I am trying to achieve? Thanks, Jose -- Sent from: http://a

Cluster High-Availability

2018-12-10 Thread joseheitor
Hi, For the event that an entire datacentre is lost, is there a way to either: 1 - Replicate an entire cluster to a remote datacentre... (with equivalent nodes)? 2 - Or to manage the backup targets in a specif

[RESOLVED] SQL WHERE Query Slow

2018-12-09 Thread joseheitor
Found the reason for the problem - and a solution... Problem is that the query-optimiser performs the final WHERE clause *first*, which results in a full table scan. The solution is to structure the query so that the original query (without the WHERE clause) is forced to be performed first, then

SQL Index Payload size?

2018-12-07 Thread joseheitor
Ho do I find the payload size of an index? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IGNITE_MAX_INDEX_PAYLOAD_SIZE

2018-12-07 Thread joseheitor
Thanks, Ilya. How can find the payload size of an existing index? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [RESOLVED] JDBC Streaming

2018-12-07 Thread joseheitor
Awesome - it worked! Thanks, Ilya. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [RESOLVED] JDBC Streaming

2018-12-07 Thread joseheitor
Thanks Ilya, Will try your suggestions... Where in the XML config do I set the 'failure detection timeout'? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [RESOLVED] JDBC Streaming

2018-12-07 Thread joseheitor
Hi Ilya, Your recommendation works - thanks. When loading a few million records, I always seem to experience a node failure on one of my two nodes. I have attached the log from a recent run on version 2.7.0, failure occurred after about 10 minutes... Please let me know if you see anything I mus

Re: IGNITE_MAX_INDEX_PAYLOAD_SIZE

2018-12-07 Thread joseheitor
I have found that issuing the CREATE INDEX commands separately (not as part of a multiple-statement command) works fine. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IGNITE_MAX_INDEX_PAYLOAD_SIZE

2018-12-07 Thread joseheitor
Thanks, Ilya, Isn't the IGNITE_MAX_INDEX_PAYLOAD_SIZE setting expecting a number (byte-count)? The SQL command(s) I run is as follows: String cmd = "DROP TABLE IF EXISTS public.transactions;" + "DROP INDEX IF EXISTS transactions_id_k_v;" + "DROP

Re: SQL Query plan confusion

2018-12-07 Thread joseheitor
My apologies, Vladimir. The query-plans are swapped around (oops!). The query-plan for the efficient query is in the 'bad' file. And vice-versa... Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

IGNITE_MAX_INDEX_PAYLOAD_SIZE

2018-12-07 Thread joseheitor
Hi, How do we set the global default IGNITE_MAX_INDEX_PAYLOAD_SIZE? (Note: Adding INLINE_SIZE xx to a CREATE INDEX command, as per the docs is throwing an SqlException!) Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

[RESOLVED] Re: Where binary downloads for 2.7.0

2018-12-05 Thread joseheitor
Seems the link should exclude the '-fabric' portion of the URL: [BAD]: ...apache-ignite-fabric-2.7.0-bin.zip [GOOD]: ...apache-ignite-2.7.0-bin.zip -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Free Network Segmentation (aka split brain problem) plugin available

2018-12-05 Thread joseheitor
Hi Luqman, Is your Segmentation plugin compatible with Ignite version 2.7.0...? Thanks, Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Where binary downloads for 2.7.0

2018-12-05 Thread joseheitor
Where can I download the binaries for version 2.7.0 (the links from the usual Downloads pge seem to be broken...)? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

[RESOLVED] JDBC Streaming

2018-12-03 Thread joseheitor
Hooray!!! - It works. Thanks, Ilya. Please continue your investigation of the JDBC Client Driver (thick-client), and let me know what you find...? What follows should perhaps be posted separately...but here's something I noticed, which I don't fully understand or know how to deal with: While bu

Re: JDBC Streaming

2018-12-03 Thread joseheitor
Hi Ilya, Thanks for the response. My understanding was that Thin JDBC driver was only able to connect to a single node (not a cluster), so that if that node failed - it was not able to continue operating on the cluster... It would also only return data residing on that node (not records residing

Re: JDBC Streaming

2018-12-02 Thread joseheitor
Hi Ilya, Any update on your investigation of this issue...? Your comments that 'streaming mode' in Client driver and Client driver itself are near-deprecated - are very surprising and concerning! 1. Are you saying that Apache Ignite SQL will seize to be accessible via standard JDBC? 2. If 'stre

Re: JDBC Streaming

2018-12-01 Thread joseheitor
Hi Ilya, Please see attached archive with simple application demonstrating the problem. ignite-streaming.gz Once you have extracted the contents of the archive - please refer to the README for instructions... (and

Re: JDBC Streaming

2018-11-29 Thread joseheitor
Hi Ilya, Yes - I am using JDBC Client driver to INSERT data into the SQL table. It works correctly (but slow) without setting 'streaming=true'. When I set 'streaming=true' in the connection string, as per the Ignite docs ( https://apacheignite-sql.readme.io/docs/jdbc-client-driver#section-streami

Misleading docs or bug?

2018-11-28 Thread joseheitor
JDBC Client connection URL with 'streaming=true' runs (much faster than without) but no data is inserted into SQL table. No errors are reported. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

control.sh from remote terminal?

2018-11-28 Thread joseheitor
Can control.sh connect to a remote cluster? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: JDBC Streaming

2018-11-27 Thread joseheitor
Can anyone help with this? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL WHERE Query Slow

2018-11-27 Thread joseheitor
Can anyone help with this? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

SQL Query plan confusion

2018-11-27 Thread joseheitor
1. - I have a nested join query on a table of 8,000,000 records which performs similar or better than PostreSQL (~10ms) on my small test setup (2x nodes, 8GB, 2CPU): SELECT mainTable.pk, mainTable.id, mainTable.k, mainTable.v FROM public.test_data AS mainTable INNER

Re: JDBC Streaming

2018-11-27 Thread joseheitor
Shouldn't I be able to do this through plain JDBC DML operations? The documentation for the JDBC Client Driver specifies this as a feature... Don't know whether I am doing something wrong, or if there is a bug? Is there any example showcasing this feature? Thanks, Jose -- Sent from: http://ap

Re: Optimum storage startegy (Advice?)

2018-11-27 Thread joseheitor
Thanks for the reply and questions, Evgenii. Here are some additional details (long-winded...sorry), to provide you with some context of the usage. The reasons for not using a Flat table structure are as follows: 1. - A real-world retail transaction has a much larger and complex structure than my

Re: JDBC Streaming

2018-11-26 Thread joseheitor
Hi Ilya, I realize that Streaming is not supported via the JDBC Client node interface (*thanks for that info). But is it possible to stream-import data via (code) SQL directly and load it into persistent SQL table? (The Ignite code examples for Streaming only show loading data into grid caches...

Re: JDBC Streaming

2018-11-25 Thread joseheitor
Is Streaming perhaps not supported with JDBC Client driver...? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Optimum storage startegy (Advice?)

2018-11-24 Thread joseheitor
Given the following model structure: { "trans": { "cust": { "firstname": "Bone", "lastname": "Klebes", "email": "[hidden email]", "gender": "Male" }, "ipaddress": "104.89.149.184", "date": "2017-12-01", "amount": 1217, "currency": "NOK" } } What

Are QuerySqlField indexes used in ScanQueries?

2018-11-24 Thread joseheitor
If model class fields are annotated with: @QuerySqlField(index = true) ... will ScanQueries with IgniteBiPredicates on the annotated fields leverage the indexes? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

BinaryObject nested fields syntax?

2018-11-24 Thread joseheitor
Given the following model data structure for a given document record: { "trans": { "cust": { "firstname": "Bone", "lastname": "Klebes", "email": "bkleb...@usgs.gov", "gender": "Male" }, "ipaddress": "104.89.149.184", "date": "2017-12-01", "amount": 121

Re: IgniteBiPredicate anonymous class - ClassNotFoundException

2018-11-23 Thread joseheitor
Thanks, Maxim - it is working. Tips for others landing on this post... I fixed my problem by: - Enabling peer classloading () on each node - Building a JAR with my model classes and manually deploying them on each server node's /libs folder -- Sent from: http://apache-ignite-users.70518.x6.nab

Re: [RESOLVED] Passing parameters to IgniteBiPredicate

2018-11-23 Thread joseheitor
Please ignore my previous post - it is working correctly: String date = "2018-10-21"; ScanQuery filter = new ScanQuery<>( new IgniteBiPredicate() { @Override public boolean apply(Integer key, Transaction trans) { ret

Re: Passing parameters to IgniteBiPredicate

2018-11-23 Thread joseheitor
Hi have the same question... did you ever find a solution? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

IgniteBiPredicate anonymous class - ClassNotFoundException

2018-11-22 Thread joseheitor
Why am I getting a ClassNotFoundException? ... I can see that the anonymous class exists inside the JAR archive: -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: JDBC Streaming

2018-11-20 Thread joseheitor
Can anyone spot if I am doing something wrong...? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

SQL Affinity colocation

2018-11-20 Thread joseheitor
I have 2 tables with the following primary/foreign key mapping (transactions.id <-> records.trans_id): *CREATE TABLE public.transactions ( id INT PRIMARY KEY, basket VARCHAR ) WITH "TEMPLATE=PARTITIONED"; CREATE TABLE public.records ( id INT, trans_id INT, last_name VARCHAR, email V

Re: JDBC Streaming

2018-11-19 Thread joseheitor
Hi Ilya, Tried executing SQL statement - 'SET STREAMING ON' from code, but this produces an exception. Here is my table definition: CREATE TABLE public.test_data ( pk LONG, id LONG, k VARCHAR, v VARCHAR, PRIMARY KEY (pk, id)) WITH "TEMPLATE=PARTITIONED, BACKUPS=1, ATOMICITY=TRANSACTIONAL, W

SQL 'affinityKey' or 'AFFINITY_KEY"

2018-11-17 Thread joseheitor
What is the correct syntax for the affinity key parameter in the WITH clause in a CREATE TABLE SQL statement? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

JDBC Streaming

2018-11-17 Thread joseheitor
JDBC Client connection URL with 'streaming=true' runs (much faster than without) but no data is inserted into table. No errors are reported. I have two nodes with one partitioned table. Without 'streaming=true' it take around 8 hours to load 8,000,000 rows. The insert loop takes only around 8 minu

Re: configuration for some persistent and some non-persistent caches

2018-09-02 Thread joseheitor
Hi Denis, I am struggling to get this properly configured for a persistent cache (DATASTORE) and a non-persistent cache (SESSIONCACHE). Here is my config ... (what am I doing wrong?):

Re: Optimum persistent SQL storage and querying strategy

2018-08-08 Thread joseheitor
Hi Ignite Team, Any tips and recommendations...? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Optimum persistent SQL storage and querying strategy

2018-08-03 Thread joseheitor
Hi Ignite team, We need to store and query retail transaction data that is expected to grow to over 50 million records. Each basket-transaction is represented as a JSON object with somewhat varying schema, depending on the type of transaction. And each transaction will contain a varying amount of

Re: Scaling with SQL query

2018-06-27 Thread joseheitor
Hi Dmitry, This is a fantastic explanation to better understand scaling strategies for SQL - Thanks. A couple of questions: 1. Do these mechanisms apply equally for persistent caches? 2. Regarding your point (2.) - How would one achieve this? (more clients?) (more connections to node?) Are these

Re: Text Query via SQL or REST API?

2018-06-15 Thread joseheitor
Thanks, Dmitry. What is the recommended strategy to most efficiently perform searches on a persistent store table containing a column with text (JSON document)...? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Text Query via SQL or REST API?

2018-06-15 Thread joseheitor
Is it possible to perform a full text search query operation via either the SQL interface? Or the REST API interface? And does this (or the Java API) automatically leverage Lucene indexing as per the documentation example for a TextQuery? Or are there other specific operations or configurations re

configuration for some persistent and some non-persistent caches

2018-04-18 Thread joseheitor
How do you configure some caches to be persistent and others not, on the same cluster? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL Transactional Support for Commit and rollback operation.

2018-04-11 Thread joseheitor
Yes - please clarify? We are also developing a product for which we are keen to use Ignite (instead of PostgreSQL), but it is a complete BLOCKER if there is no persistent SQL Transactional support. So we also require this urgently! (Please, please, please...) -- Sent from: http://apache-ignite

Re: Redis KEYS command?

2018-03-27 Thread joseheitor
Thanks for the suggestion Andrey. We are wishing to keep our code-base compatible with Redis, so not Ignite-specific code. But we do need support for the Redis KEYS command... Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Redis KEYS command?

2018-03-27 Thread joseheitor
Hi, Is there any intention of implementing support for the Redis KEYS command in the near future? Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [2.4.0] Cluster unrecoverable after node failure

2018-03-24 Thread joseheitor
Thanks Arseny - I really appreciate your assistance! The config files that I use are included in the attached archive. ignite-replicated.zip Let me know if you need anything else, or any clarification? Below (fo

Re: [2.4.0] Cluster unrecoverable after node failure

2018-03-23 Thread joseheitor
Hi Arseny, Regrettably still experiencing the same results. Could there be something else that I am overlooking? My configurations are quite basic - I can post them, if it will be helpful for you to duplicate the issue... Thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [2.4.0] Cluster unrecoverable after node failure

2018-03-23 Thread joseheitor
Hi Arseny, Can this be set in the configuration file for each node? (like a property?) Our application is aiming (currently) to use Ignite purely as a distributed, persistent and cached, fault-tolerant SQL database through the Client JDBC driver. It does/must not instantiate (depend on) any Ignit

Re: [2.4.0] Cluster unrecoverable after node failure

2018-03-22 Thread joseheitor
Hi Pavel, 1. Disconnect database connection 2. Stop all component processes on all nodes (Ctl+C) 3. I delete the 'work' folder on the node on which I want to simulate an unrecoverable hardware failure. When the node is started up anew - it is like deploying a new instance on the same IP address.

Re: [2.4.0] Cluster unrecoverable after node failure

2018-03-22 Thread joseheitor
I do apologise for the long-winded post earlier (with error stack-traces, etc.). And hope that someone can assist me with this issue - it is a basic, real-world scenario that tests the fundamental integrity of the clustering system! Am I perhaps missing something? Or mismanaging the cluster in su

DROP TABLE(s) reimerge after restart

2018-03-20 Thread joseheitor
With native persistence enabled. Steps to recreate: 1 - DROP TABLE(s) containing data via SQL JDBC (Client-Driver) on DBeaver 2 - confirm tables gone by refreshing DBeaver 'Database Navigator' panel and observing that previously listed tables are no longer present 3 - reboot and restart nod

[2.4.0] Cluster unrecoverable after node failure

2018-03-20 Thread joseheitor
*Scenario A: Secondary (Node-B) Failure* Environment: - 2 nodes (Node-A, Node-B) - Ignite native persistence enabled - static IP discovery - both node IPs listed - JDBC (Client) - DBeaver - manual cluster activation Steps: 1 - start both nodes with no data 2 - activate cluster on

Understanding SQL CREATE TABLE 'WITH' Parameters?

2018-03-15 Thread joseheitor
Three questions regarding relationship of cached data to persisted data: 1) Do the settings of the parameters in the 'WITH' clause apply only to the cached data? Or also to the persisted data? 2) Can the parameters set in a CREATE TABLE 'WITH' clause be rather externally and globally set in a co

Liquibase with Ignite?

2018-03-13 Thread joseheitor
Is anyone using Liquibase with Apache Ignite native SQL persistence? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite with dBeaver

2018-03-06 Thread joseheitor
Hi Wilhem, I have also been evaluating Ignite, and also followed the steps in setting up SQL tooling with DBeaver... At that final step, when you choose a driver class - I had a choice (from a pulldown list, I think) between the two classes. You can then select the Thin version for simple local c

Re: How to configure a cluster as a persistent, replicated SQL database

2018-03-06 Thread joseheitor
Hi Naveen, I managed to get everything up a and running...but for my testing, I have not been connecting from code. I have been using DBeaver to connect using SQL via the JDBC driver(s). Jose -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to configure a cluster as a persistent, replicated SQL database

2018-03-04 Thread joseheitor
Okay - figured it out... Had to prefix the 'PUBLIC' schema to the table name during the CREATE TABLE query: CREATE TABLE PUBLIC.City(... -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

  1   2   >