Persistence error in Cygnus
Hello,
We are experiencing an error in cygnus when trying to persist data to cosmos. We tried to create directories directly with an http request ourselves and that worked fine. I am not sure what kind of information you might need to help, but this is the error message we get in the logs:
14 Dec 2015 17:11:41,405 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (com.telefonica.iot.cygnus.backends.http.HttpBackend.doRequest:195) - Http request: PUT http://cosmos.lab.fiware.org:14000/we...parkingsection?op=mkdirs&user.name=developer HTTP/1.1 14 Dec 2015 17:11:41,405 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.PoolingClientConnectionManager.requestConnection:182) - Connection request: [route: {}->http://cosmos.lab.fiware.org:14000][total kept alive: 0; route allocated: 0 of 100; total allocated: 0 of 500] 14 Dec 2015 17:11:41,406 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.PoolingClientConnectionManager.leaseConnection:214) - Connection leased: [id: 7][route: {}->http://cosmos.lab.fiware.org:14000][total kept alive: 0; route allocated: 1 of 100; total allocated: 1 of 500] 14 Dec 2015 17:11:41,406 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection:175) - Connecting to cosmos.lab.fiware.org:14000 14 Dec 2015 17:11:41,439 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.client.protocol.RequestAddCookies.process:122) - CookieSpec selected: best-match 14 Dec 2015 17:11:41,440 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.client.protocol.RequestAuthCache.process:75) - Auth cache not set in the context 14 Dec 2015 17:11:41,440 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.client.protocol.RequestTargetAuthentication.process:78) - Target auth state: UNCHALLENGED 14 Dec 2015 17:11:41,440 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.client.protocol.RequestProxyAuthentication.process:87) - Proxy auth state: UNCHALLENGED 14 Dec 2015 17:11:41,440 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.client.DefaultRequestDirector.tryExecute:680) - Attempt 1 to execute request 14 Dec 2015 17:11:41,440 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.DefaultClientConnection.sendRequestHeader:268) - Sending request: PUT /webhdfs/v1/user/developer/parking/occupancy/206parkingsection?op=mkdirs&user.name=developer HTTP/1.1 14 Dec 2015 17:11:41,441 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "PUT /webhdfs/v1/user/developer/parking/occupancy/206parkingsection?op=mkdirs&user.name=developer HTTP/1.1[\r][\n]" 14 Dec 2015 17:11:41,441 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "X-Auth-Token: *********************** [\r][\n]" 14 Dec 2015 17:11:41,441 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "Content-Length: 0[\r][\n]" 14 Dec 2015 17:11:41,441 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "Host: cosmos.lab.fiware.org:14000[\r][\n]" 14 Dec 2015 17:11:41,442 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "Connection: Keep-Alive[\r][\n]" 14 Dec 2015 17:11:41,442 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.http.impl.conn.Wire.wire:72) - >> "User-Agent: Apache-HttpClient/4.3.1 (java 1.5)[\r][\n]" 14 Dec 2015 17:11:41,442 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor ...
Which Cygnus version are you running? Which is the OS of the machine running Cygnus? By the way, this kind of technical questions is better to be done at stackoverflow.com (fiware-cygnus tag), just for the next time ;)
Thank you for getting back, we are running Cygnus version 0.11.0, which should be the latest on CentOS release 6.6 (Final), which is part of the Orion Context Broker image that runs on the FIWARE lab, that should be version 4.4. I'll follow your comment and use Stackoverflow next time :-)
After confirming the issue with a Cygnus deploymnet of our own, we have decided this is an issue regarding version 0.11.0. This has been described at https://github.com/telefonicaid/fiware-cygnus/issues/680. My recommendation is to rollback to Cygnus 0.10.0 while we go deeper into the details.
Thank you for checking and entering an issue on Github. Would you have any suggestions for us on how to roll back in the most seamless manner?
Start by effectively removing all Cygnus 0.11.0 stuff; the following command will do that: $ sudo rpm -e -vv --allmatches --nodeps --noscripts --notriggers cygnus Then, simply install the 0.10.0 version: $ sudo yum install cygnus-0.10.0