Skip to content

Make gradoop demo work with gradoop-compatible datasets from HDFS ... #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 22 commits into
base: master
Choose a base branch
from
Open

Make gradoop demo work with gradoop-compatible datasets from HDFS ... #4

wants to merge 22 commits into from

Conversation

@kedarmhaswade
Copy link

@kedarmhaswade kedarmhaswade commented May 8, 2018

The idea is simple:

  • host gradoop demo server somewhere,
  • ask users to put their gradoop datasets (that they want to visualize and run Cypher queries on, against a Flink cluster) at a location in HDFS.

Gradoop, if the datasets are valid gradoop datasets (metadata, vertices and edges), starts acknowledging them, just like the bundled ones.

kedarmhaswade and others added 22 commits April 5, 2018 17:27
@kedarmhaswade
some basic changes
343c85e
@kedarmhaswade
make the main thread 'wait'
d8d4a64
@kedarmhaswade
trying to work with remote cluster
29beaf2
@kedarmhaswade
change the name of the jar in script
8f6beac
@kedarmhaswade
add target/classes back to use the static web resources
73f47ec
@kedarmhaswade
use plain host/port api for Remote Environment
5a44e83
@kedarmhaswade
Merge branch 'master' into dev
b7737c4
@kedarmhaswade
added unit tests for HDFS reading of graphsets
19331fb
@kedarmhaswade
make tests more resilient
0c9fa99
@kedarmhaswade
comment out the test; trying to reproduce Chesnay's environment for F…
042e5f8 
…LINK-9267
@kedarmhaswade
enable the test, but ignore it for mini-cluster does not work yet (hi…
e94c9e0 
…nt: JAR hell)
@kedarmhaswade
add hdfs cache support
a7c8c75
@kedarmhaswade
make unit tests work
33b7f8f
@kedarmhaswade
moved logic to javascript
341807d
@kedarmhaswade
add hadoop fs properties
7c56c4b
@kedarmhaswade
use hdfs file system
e4fd03c
@kedarmhaswade
add log4j.properties; adjust tests
b1d82b8
@kedarmhaswade
prevent removal of graphset file from HDFS; better logging
e201021
@kedarmhaswade
use slf4j parameters uniformly
7d867dc
@kedarmhaswade
move to Configuration from cluster URI according to Hadoop team
7aed8f3
@kedarmhaswade
adding some parameters for hdfs to be on the safer side
631aae7
@kedarmhaswade
Merge branch 'dev'
3e1d34b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@kedarmhaswade