Greetings,
I have a vCCServer 2.0 on nat-routed network behind vCNetwork and Security edge firewall and set of firewall/nat rules to allow unrestricted communication between vCCS and vcloud.vmware.com. When I try to register or update registration of vCCS with vcloud.vmware.com , I get "Error: 501 null" under 'vcloud.vmware.com' tab.
When I log out and log back in to vCCS I get the messages that 'Server is registered with Portal' but any changes followed by 'register' or 'update registration' result in aformentioned 501 error.
The network connectivity between vCCS and vcloud.vmware.com seems to be fine, I even succesfully tested it using 'curl -k -v https://vcloud.vmware.com/api/versions' (http://pubs.vmware.com/hybridcloud/index.jsp?topic=/com.vmware.vcc.install.doc_1/GUID-7D227BAB-9251-4DF1-A9AD-22A8E771760C.html).
Here's the output of the /opt/vmware/hcserver/logs/hcs.log on vCCS that pertains to the attempt to register with vcloud.vmware.com:
vccserver19809:/opt/vmware/hcserver/logs # tail -f hcs.log
2013-03-25 03:22:35.707 UTC [pool-3-thread-1] DEBUG c.v.h.s.c.impl.CloudRepositoryImpl - Clearing sync flag.
2013-03-25 03:22:35.717 UTC [pool-3-thread-1] DEBUG c.v.h.s.c.impl.CloudRepositoryImpl - Updated syncStart of 1 clouds.
2013-03-25 03:22:35.719 UTC [pool-3-thread-1] INFO c.v.hc.server.ApplicationInitializer - Enter checkAndUpdateVCloudReg
2013-03-25 03:22:35.727 UTC [pool-3-thread-1] INFO c.v.hc.server.ApplicationInitializer - Exit checkAndUpdateVCloudReg
2013-03-25 03:22:55.702 UTC [scheduler-1] INFO c.v.h.s.c.a.impl.AgentAdaptorImpl - Marking node Local Content Library Up.
2013-03-25 03:22:56.009 UTC [tomcat-http--2] DEBUG c.v.hc.server.rest.UserController - User admin logged into session 2747F4EA4B0A02E3F34F5757962FEFEC.
2013-03-25 03:22:56.009 UTC [tomcat-http--3] DEBUG c.v.hc.server.rest.UserController - User admin logged into session FF33201DBEE814696AA32B516CF1DB80.
2013-03-25 03:22:56.174 UTC [tomcat-http--6] DEBUG c.v.h.s.r.VsphereExtensionController - Server is not registered with any vCenter.
2013-03-25 03:22:56.263 UTC [tomcat-http--10] DEBUG c.v.hc.server.rest.UserController - Logging out from session org.apache.catalina.session.StandardSessionFacade @65050797.
2013-03-25 03:22:56.265 UTC [tomcat-http--9] DEBUG c.v.hc.server.rest.UserController - Logging out from session org.apache.catalina.session.StandardSessionFacade@ 12f80f07.
2013-03-25 03:24:54.161 UTC [tomcat-http--14] DEBUG c.v.hc.server.rest.UserController - User admin logged into session 098D41DC911A83416A3B7AFA734FBE73.
2013-03-25 03:24:54.194 UTC [tomcat-http--16] DEBUG c.v.h.s.c.v.i.VcloudPortalAdaptorImpl - Invoking portal registration API with parameters: EMAIL-ADDRESS-HIDDEN, http://IP-HIDDEN:80, 2
2013-03-25 03:24:54.216 UTC [tomcat-http--16] DEBUG c.v.h.common.ValidatingProxySelector - Removed proxy DIRECT.
2013-03-25 03:24:54.442 UTC [tomcat-http--16] WARN o.s.web.client.RestTemplate - PUT request for "https://vcloud.vmware.com:443/api/1.0/hcserver/7851" resulted i n 501 (Not Implemented); invoking error handler
2013-03-25 03:24:54.445 UTC [tomcat-http--16] DEBUG c.v.h.e.GlobalExceptionResolver - Resolving exception from handler [com.vmware.hc.server.rest.PortalController @3247c372]: org.springframework.web.client.HttpServerErrorException: 501 null
2013-03-25 03:24:54.446 UTC [tomcat-http--16] DEBUG c.v.h.e.GlobalExceptionResolver - Attempting to retrieve a mapping from the ExceptionController for exception [org.springframework.web.client.HttpServerErrorException, com.vmware.hc.server.rest.PortalController$$EnhancerByCGLIB$$24406fc5_2] raised in org.springframework.w eb.client.HttpServerErrorException: 501 null
2013-03-25 03:24:54.448 UTC [tomcat-http--16] DEBUG c.v.h.e.GlobalExceptionResolver - Invoking request handler method: public com.vmware.hc.rest.beans.HcError com .vmware.hc.rest.ExceptionController.handleRestClientException(org.springframework.web.client.RestClientException)
2013-03-25 03:24:54.451 UTC [tomcat-http--16] INFO c.vmware.hc.rest.ExceptionController - Handling RestClientException.
org.springframework.web.client.HttpServerErrorException: 501 null
at com.vmware.hc.rest.ResponseErrorHandler.handleError(ResponseErrorHandler.java:71) ~[common-2.0.0.0-SNAPSHOT.jar:na]
at org.springframework.web.client.RestTemplate.handleResponseError(RestTemplate.java:494) ~[spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:451) ~[spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.client.RestTemplate.execute(RestTemplate.java:409) ~[spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.client.RestTemplate.put(RestTemplate.java:335) ~[spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at com.vmware.hc.server.cloud.vcloud.impl.VcloudPortalAdaptorImpl.doRegister(VcloudPortalAdaptorImpl.java:189) ~[VcloudPortalAdaptorImpl.class:na]
at com.vmware.hc.server.cloud.vcloud.impl.VcloudPortalAdaptorImpl.update(VcloudPortalAdaptorImpl.java:309) ~[VcloudPortalAdaptorImpl.class:na]
at com.vmware.hc.server.rest.PortalController.update(PortalController.java:101) ~[PortalController.class:na]
at com.vmware.hc.server.rest.PortalController$$FastClassByCGLIB$$616f409d.invoke(<generated>) ~[cglib-2.2.jar:na]
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:191) ~[cglib-2.2.jar:na]
at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:689) ~[spring-aop-3.1.2.RELEASE.jar:3.1.2.RE LEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:150) ~[spring-aop-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:61) ~[spring-security-core-3. 1.1.RELEASE.jar:3.1.1.RELEASE]
at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:172) ~[spring-aop-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:622) ~[spring-aop-3.1.2.RELEASE.jar:3.1.2.RELE ASE]
at com.vmware.hc.server.rest.PortalController$$EnhancerByCGLIB$$24406fc5_2.update(<generated>) ~[cglib-2.2.jar:na]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[na:1.7.0_07]
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source) ~[na:1.7.0_07]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.7.0_07]
at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.7.0_07]
at org.springframework.web.bind.annotation.support.HandlerMethodInvoker.invokeHandlerMethod(HandlerMethodInvoker.java:176) ~[spring-web-3.1.2.RELEASE.jar: 3.1.2.RELEASE]
at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.invokeHandlerMethod(AnnotationMethodHandlerAdapter.java:436) ~[spring-web mvc-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.servlet.mvc.annotation.AnnotationMethodHandlerAdapter.handle(AnnotationMethodHandlerAdapter.java:424) ~[spring-webmvc-3.1.2.REL EASE.jar:3.1.2.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:923) ~[spring-webmvc-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:852) ~[spring-webmvc-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:882) ~[spring-webmvc-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:789) ~[spring-webmvc-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:641) [servlet-api.jar:na]
at javax.servlet.http.HttpServlet.service(HttpServlet.java:722) [servlet-api.jar:na]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) [catalina.jar:7.0.26.A]
at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87) [spring-security-web-3.1.1 .RELEASE.jar:3.1.1.RELEASE]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) [catalina.jar:7.0.26.A]
at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88) [spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:76) [spring-web-3.1.2.RELEASE.jar:3.1.2.RELEASE]
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:224) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:169) [catalina.jar:7.0.26.A]
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:472) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:168) [catalina.jar:7.0.26.A]
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:98) [catalina.jar:7.0.26.A]
at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:927) [catalina.jar:7.0.26.A]
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118) [catalina.jar:7.0.26.A]
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:407) [catalina.jar:7.0.26.A]
at org.apache.coyote.http11.AbstractHttp11Processor.process(AbstractHttp11Processor.java:987) [tomcat-coyote.jar:7.0.26.A]
at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:579) [tomcat-coyote.jar:7.0.26.A]
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.run(NioEndpoint.java:1600) [tomcat-coyote.jar:7.0.26.A]
at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) [na:1.7.0_07]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) [na:1.7.0_07]
at java.lang.Thread.run(Unknown Source) [na:1.7.0_07]
2013-03-25 03:24:54.457 UTC [tomcat-http--17] DEBUG c.v.hc.server.rest.UserController - Logging out from session org.apache.catalina.session.StandardSessionFacade
Additional notes: vCCS has SSL disabled (don't have trusted SSL cert); I even tried deploying new instance but got the same error message.
Does anybody have any clues?
Thanks,
PD