[Bug] Gremlin Connector Timeout when Fetching Vertex Schema upon Database Synchronizing #225
Labels
bug
Something isn't working
database support
Issues related to adding or changing the databases servers or languages supported
discussion
Support/further information is requested
reliability
Issues relating to improvements in reliability
Milestone
Community Note
Describe the bug
When synchronizing Graph Explorer UI using the Gremlin Connector, the synchronization fails due to a timeout.
The timeout occurs when executing the code that fetches vertices attributes (fetchVerticesAttributes) - it makes an HTTP call to the graph-explorer's proxy URL.
GP-Gremlin
as default connectionTo Reproduce
Steps to reproduce the behavior:
Notebooks
(https://us-west-2.console.aws.amazon.com/neptune/home?region=us-west-2#notebooks:
)Actions
buttonOpen Graph Explorer
GP-Gremlin
default connectionSynchronize Database
icon (top-right of UI view)See screen capture of the graph-explorer UI, along with log showing network activity upon step 7 above. Note the timeout after 2 minutes for the HTTP request.
Expected behavior
The expected behavior upon clicking the
Synchronize Database
icon would be to receive a success notification after a few seconds (i.e. something less than 10 seconds).Some Additional Notes
The gremlin query being executed via the above mentioned proxy HTTP call is generated by the verticesSchemaTemplate function.
In our case, the query produced by
verticesSchemaTemplate
function is as follows (the label names have been changed in this example):Upon further investigation, it was found that this query works for databases smaller than the one we currently have deployed.
As a mitigation to the size of the database we ran the query with an extended timeout and it completed with success, but it took over 8 minutes to complete. The default timeout is 2 minutes, and hence the Sychronization fails in the Graph Explorer UI.
A proposed query (that should return an equivalent result), completes successfully in under 1 second for our graph database:
Explanation of the proposed query above:
See attached files for more details about our graph and the execution of the incumbent query and proposed query:
Some Cluster Status Info (see details cluster_status.json):
Graph Summary (see details graph_summary.json):
Graph Statistics (see details graph_statistics.json)
The
Explain
andProfile
of the currently used query (verticesSchemaTemplate)ge-query-explain.txt
ge-query-profile.txt
The
Explain
andProfile
of the proposed query, above:ge-query-modified-explain.txt
ge-query-modified-profile.txt
The text was updated successfully, but these errors were encountered: