Import failing between dev and prod instances
12 November, 2013
Hi,
I'm unable to import reports from our Dev instance into our Prod instance. (2 separate web servers and SQL databases)
The export file does get read, and I can move all the way to the Summary screen. Once I click "Import", that is where it fails. Just sits there with the hourglass churning.
We used to be able to do this. Something in the latest patch seems to have broken the ability.
We're running the exact same hardware/software in each instance. Also the version of Yellowfin is the same (version 6.3. Oct patch).
Suggestions?
----------------
Enclosed is data from the logs.
Yellowfin.log
[code]
YF:2013-11-12 17:05:04: INFO (MIAdminImportAction:execute) - MIAdminImportAction entered
YF:2013-11-12 17:05:06: INFO (MIAdminImportAction:execute) - MIAdminImportAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:06: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:06: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:24: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:24: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:25: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:25: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:27: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:27: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:27: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:27: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:29: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:29: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:29: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:29: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:34: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:34: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:34: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:34: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:38: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:38: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportSummary
YF:2013-11-12 17:05:38: INFO (MIPreAdminImportSummaryAction:execute) - MIPreAdminImportSummaryAction entered
YF:2013-11-12 17:05:38: INFO (MIPreAdminImportSummaryAction:execute) - MIPreAdminImportSummaryAction exiting with action: summaryv4
YF:2013-11-12 17:05:41: INFO (MIAdminImportSummaryAction:execute) - MIAdminImportSummaryAction entered
================================
[/code]
stdout_20131112.log
[code]
ClientAbortException: java.net.SocketException: Software caused connection abort: socket write error
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:327)
at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:293)
at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:98)
at java.io.BufferedOutputStream.flush(Unknown Source)
at com.hof.mi.web.action.MIReportImageAction.execute(MIReportImageAction.java:203)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:484)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:274)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:507)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:627)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketException: Software caused connection abort: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes(InternalOutputBuffer.java:750)
at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:432)
at org.apache.coyote.http11.InternalOutputBuffer.flush(InternalOutputBuffer.java:305)
at org.apache.coyote.http11.Http11Processor.action(Http11Processor.java:997)
at org.apache.coyote.Response.action(Response.java:183)
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:322)
... 24 more
[/code]
I'm unable to import reports from our Dev instance into our Prod instance. (2 separate web servers and SQL databases)
The export file does get read, and I can move all the way to the Summary screen. Once I click "Import", that is where it fails. Just sits there with the hourglass churning.
We used to be able to do this. Something in the latest patch seems to have broken the ability.
We're running the exact same hardware/software in each instance. Also the version of Yellowfin is the same (version 6.3. Oct patch).
Suggestions?
----------------
Enclosed is data from the logs.
Yellowfin.log
[code]
YF:2013-11-12 17:05:04: INFO (MIAdminImportAction:execute) - MIAdminImportAction entered
YF:2013-11-12 17:05:06: INFO (MIAdminImportAction:execute) - MIAdminImportAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:06: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:06: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:07: INFO (PropertyMessageResources:) - Initializing, config='org.apache.struts.taglib.html.LocalStrings', returnNull=true
YF:2013-11-12 17:05:24: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:24: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:25: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:25: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:27: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:27: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:27: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:27: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:29: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:29: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:29: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:29: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:34: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:34: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportValidate
YF:2013-11-12 17:05:34: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction entered
YF:2013-11-12 17:05:34: INFO (MIPreAdminImportValidateAction:execute) - MIPreAdminImportValidateAction exiting with action: validatev4
YF:2013-11-12 17:05:38: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateV4Action entered
YF:2013-11-12 17:05:38: INFO (MIAdminImportValidateV4Action:execute) - MIAdminImportValidateAction exiting with action: MIAdminImportSummary
YF:2013-11-12 17:05:38: INFO (MIPreAdminImportSummaryAction:execute) - MIPreAdminImportSummaryAction entered
YF:2013-11-12 17:05:38: INFO (MIPreAdminImportSummaryAction:execute) - MIPreAdminImportSummaryAction exiting with action: summaryv4
YF:2013-11-12 17:05:41: INFO (MIAdminImportSummaryAction:execute) - MIAdminImportSummaryAction entered
================================
[/code]
stdout_20131112.log
[code]
ClientAbortException: java.net.SocketException: Software caused connection abort: socket write error
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:327)
at org.apache.catalina.connector.OutputBuffer.flush(OutputBuffer.java:293)
at org.apache.catalina.connector.CoyoteOutputStream.flush(CoyoteOutputStream.java:98)
at java.io.BufferedOutputStream.flush(Unknown Source)
at com.hof.mi.web.action.MIReportImageAction.execute(MIReportImageAction.java:203)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:484)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:274)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1482)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:507)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:627)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:729)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:269)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:188)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:172)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:117)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:108)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:174)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:875)
at org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:665)
at org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:528)
at org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:81)
at org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:689)
at java.lang.Thread.run(Unknown Source)
Caused by: java.net.SocketException: Software caused connection abort: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method)
at java.net.SocketOutputStream.socketWrite(Unknown Source)
at java.net.SocketOutputStream.write(Unknown Source)
at org.apache.coyote.http11.InternalOutputBuffer.realWriteBytes(InternalOutputBuffer.java:750)
at org.apache.tomcat.util.buf.ByteChunk.flushBuffer(ByteChunk.java:432)
at org.apache.coyote.http11.InternalOutputBuffer.flush(InternalOutputBuffer.java:305)
at org.apache.coyote.http11.Http11Processor.action(Http11Processor.java:997)
at org.apache.coyote.Response.action(Response.java:183)
at org.apache.catalina.connector.OutputBuffer.doFlush(OutputBuffer.java:322)
... 24 more
[/code]
Hi again,
I rolled both Dev and Prod back to the Sept patch build. The import is working correctly now.
However, the October patch had a fix in it for a report export (UTF8 fix) that we need.
Hopefully, this import issue can be fixed for the Nov patch.
Regards,
Chris
I rolled both Dev and Prod back to the Sept patch build. The import is working correctly now.
However, the October patch had a fix in it for a report export (UTF8 fix) that we need.
Hopefully, this import issue can be fixed for the Nov patch.
Regards,
Chris
Hi Chris,
for import issues we generally ask for a backup of the client's YF config db and also the schema of their data warehouse (we don�t need the actual data, just the table/column structure) and of course the xml export file, that way we can setup your environment over here and then step through the code. Is there any chance you'll be able to get those across to us? If you can then I'll create an FTP account for you and send you the details.
Also, in the future can you please not post log files or excerpts on the forum as we try to keep the forum for "how to" questions, just email them to us.
regards,
Dave
for import issues we generally ask for a backup of the client's YF config db and also the schema of their data warehouse (we don�t need the actual data, just the table/column structure) and of course the xml export file, that way we can setup your environment over here and then step through the code. Is there any chance you'll be able to get those across to us? If you can then I'll create an FTP account for you and send you the details.
Also, in the future can you please not post log files or excerpts on the forum as we try to keep the forum for "how to" questions, just email them to us.
regards,
Dave
Hi Dave,
Since I rolled the patch back, I do not have the version now that was causing the issue readily available.
I'll update our Cert instance to the October patch again and pull the information you need.
Regards,
Chris
Since I rolled the patch back, I do not have the version now that was causing the issue readily available.
I'll update our Cert instance to the October patch again and pull the information you need.
Regards,
Chris
Hi Chris,
or if you want, to save you going through that you could send us your Sept builds of Dev and Prod and we'll upgrade them to the Oct build over here, and then create the export file and hopefully reproduce the import issue.
regards,
Dave
or if you want, to save you going through that you could send us your Sept builds of Dev and Prod and we'll upgrade them to the Oct build over here, and then create the export file and hopefully reproduce the import issue.
regards,
Dave
Hi Dave,
I have the Sept build files, schema, and export files. Go ahead and setup a FTP area and send me details.
Thanks,
Chris
I have the Sept build files, schema, and export files. Go ahead and setup a FTP area and send me details.
Thanks,
Chris
Hi Chris,
I've set up your FTP account, you should have received an auto-email with your log in details. Please let us know if you didn't.
regards,
Dave
I've set up your FTP account, you should have received an auto-email with your log in details. Please let us know if you didn't.
regards,
Dave
Hi,
Update: FTP of data to Yellowfin Support was successful. They were able to recreate the issue. Also found that upgrading to the Dec 2013 patch corrected the issue.
I still believe the Oct 2013 patch should be looked at, and a root cause determined/identified, so as to prevent a similar issue in the future.
Thanks to Yellowfin Support for all their help.
Best Regards,
Chris
Update: FTP of data to Yellowfin Support was successful. They were able to recreate the issue. Also found that upgrading to the Dec 2013 patch corrected the issue.
I still believe the Oct 2013 patch should be looked at, and a root cause determined/identified, so as to prevent a similar issue in the future.
Thanks to Yellowfin Support for all their help.
Best Regards,
Chris
Hi Chris,
Thanks for letting us know. I do believe the December release of 6.3 included a fix for the import/export process, so I suspect this is what fixed your issue.
If you do come across any issues again, please let us know.
Regards,
David
Thanks for letting us know. I do believe the December release of 6.3 included a fix for the import/export process, so I suspect this is what fixed your issue.
If you do come across any issues again, please let us know.
Regards,
David