March 27, 2009
March 11, 2009
Zimbra Attachment Parsing Bugs
After a morning of troubleshooting poor performance on an archive store that was causing backups on the mtas I would bet we’ve hit a regression. Zimbra doesn’t recognize it.
One of the admins IM’ed me a little after 9am yesterday complaining of queue backups on the mtas delivering to the archive store. They have 5 user stores and 1 archive store.
Connecting to port 7025 (lmtp) on the archive store shows sporadic hangs. Some mail was getting in but thousands were backed up on the mtas.
A quick look at the mailbox.log showed errors connecting to the conversion daemon:
2009-03-05 10:25:54,909 WARN [LmtpServer-20] [name=user-20080704@domain.tld.archive;
mid=70;] ParsedMessage - Unable to parse part 2 (file.pdf, application/pdf) of
message with Message-ID <000f01c29c4e$3434d3c0$315c200a@user.domain.tld>.
com.zimbra.cs.mime.MimeHandlerException: cannot extract text
at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(
DefaultHandler.java:117)
at com.zimbra.cs.mime.MimeHandler.getContent(MimeHandler.java:148)
at com.zimbra.cs.mime.ParsedMessage.analyzePart(ParsedMessage.java:1148)
at com.zimbra.cs.mime.ParsedMessage.analyzeNonBodyParts(ParsedMessage.java:426)
...
Caused by: com.zimbra.cs.convert.ConversionException: Cannot extract text from
document that previously crashed convertd.
at com.zimbra.cs.convert.TransformationClient.extract(
TransformationClient.java:196)
at com.zimbra.cs.convert.SocketTransformationStub.doExtract(
SocketTransformationStub.java:84)
at com.zimbra.cs.convert.SocketTransformationStub.extract(
SocketTransformationStub.java:116)
at com.zimbra.cs.mime.handler.DefaultHandler.getContentImpl(
DefaultHandler.java:111)
... 27 more
So on first look convertd died, I restarted it:
su - zimbra -c "zmconvertctl start"
convertd started and the errors in mailbox.log went away. But kvoop processes started to consume cpu. The load rose to almost 30.
This is the kvoop bug we fixed by turning of attachment indexing.. So I checked that and archiving is on again on the archive cos(!)
zimbra@host log]$ zmprov gc default |grep -i attachment
zimbraAttachmentsBlocked: FALSE
zimbraAttachmentsIndexingEnabled: FALSE
zimbraAttachmentsViewInHtmlOnly: FALSE
[zimbra@host log]$ zmprov gc archive |grep -i attachment
zimbraAttachmentsBlocked: FALSE
zimbraAttachmentsIndexingEnabled: TRUE
zimbraAttachmentsViewInHtmlOnly: FALSE
[zimbra@host log]$
zimbra@host log]$ zmprov modifyCos archive zimbraAttachmentsIndexingEnabled
FALSE
zimbra@host log]$
I flushed the queues and all is well.
http://wiki.zimbra.com/index.php?title=Disable_Indexing_for_Specific_File_Types
http://bugzilla.zimbra.com/show_bug.cgi?id=14016
Look at the bottom of the bugzilla link: It looks to me like we’re hitting a regression: a bug they thought they fixed in 4.5.x is resurfacing in 5.0.x:
------- Comment #10 From tech 2008-10-06 03:44:08 -------
this bug seems to have started happening intermittently on my 5.04 rhel_x86
installation it hangs the server so i have to reboot
RSI Log: weeks of 2/2 and 2/9
I spent the week of 2/2 I spent on site with a customer. I took my Kinesis keyboard and iFold stand and various hand rests with me. I was in more consistent pain than I can remember for most of the week. I experimented with various heights of wrist wrests by inserting dense foam (designed for motorcycle race seats). Ultimately I think my chair was too low. Sit in your chair, put your elbows at your sides bent 90 degrees and shrug your shoulders–that was about the level of the keyboard.
2/9 I was back to my regular desk in where I am able to raise the chair high enough that the keyboard is right below my hands with my elbows at my side and bent 90 degrees. That and a gel support for my mouse hand is working well and I am maybe even typing faster than normal. I am not using wrist rests at the keyboard: in theory with my elbows at my sides I am suspending only my hands and forearms. Bellis and Damany advocate no wrist rests.
The nerve “twanginess” is all but gone, replaced by some pain in my elbows around the ulnar nerve. Bending my elbow is consistently less painful this week: I can button a shirt, put on a motorcycle helmet, braid my hair etc, with only minimal pain.
I am finding when I sleep I notice very slight numbness in my hands more than usual, about half the time in the ulnar distribution. It’s slight to the point that it might be in my head. I am sleeping with B more nights than not and she often sleeps on one of my arms.. I find I can rotate my arm slightly or shift my weight to a more bony part of my arm to make the numbness go away.
I discovered this weekend that I have traded sleeping on my arm with my elbow bent for leaning on or contorting my wrist. I’ll need to work on that.