Demo Discussion
Forum Config Examples Contributions Vulnerabilities
  Discussion forum about ELOG, Page 293 of 808  Not logged in ELOG logo
New entries since:Thu Jan 1 01:00:00 1970
ID Date Icon Author Author Email Category OS ELOG Version Subjectdown
  66891   Fri Sep 3 19:04:46 2010 Reply Renee Poutissourenee@triumf.caCommentLinux | Mac OSX2.8.0Re: Synchronizing mirror causes corruption of logbook entries with multiple logbooks defined?

Andreas Luedeke wrote:

Glenn Horton-Smith wrote:

We have been experiencing corruption of logbook entries by elogd mirror synchronization. Has anyone else encountered this? Is there a known cause and/or workaround for it? [...]

I made copies of both servers' files and ran two elogd servers on my Mac on different ports, compiled from a fresh checkout of 2.8.0, and the same behavior was observed as I repeatedly made test entries and synchronized.  This suggests it isn't specific to Linux architecture, 64-bit or otherwise. 

We plan to use ELOG with mirror servers in a larger scale here, so I'm interested to know more about your problem.

Could you boil down your configuration to a minimum that still allows a reproduction of the problem and post those configurations as attachments?

Then I would try to reproduce it here. Best case I'll find a bug fix, worst case I'll reconsider the use of mirror servers ;-)

 I have been using the mirror mechanism for one year for the online T2K /ND280 (neutrino oscillation experiment at J-PARC, Japan).  It has been a savior to allow access to all collaborators to the Elog.  The experiment online computers are all behind a double firewall that allow only communication through ssh and http in one direction: from the inside to the outside. The master Elog is located in Canada and accessible remotely to all collaborators.  The mirror Elog is located inside the firewall on one of the online machines in Japan and synchronization is setup to run automatically every 5 minutes. There are 10 logbooks defined for each of the sub-detector groups.

At first I encountered a big problem when messages were added on both sides.  It turned out that Elog mirroring does not work when the two instances are running on different time zones. After I set the machine in Canada to run on Japan time (JST), no further problems have happened. Postings are routinely entered on either of the Elogs and synchronization works well.  This feature is essential to having a workable Elog for the T2K experiment. 

I had reported the problem of timezones to Stefan last year. He was going to put it on his wish list.

 

  2121   Thu Jan 18 20:19:22 2007 Reply Stefan Rittstefan.ritt@psi.chQuestionLinux | Mac OSX2.6.3-1762Re: Synchronization using https

Alexandre Lindote wrote:
Now we want to have several servers set up (in different institutions), and have them synchronized automatically.


Synchronization works such that the "client" elogd (the one on which the synchronization is started) "emulates" a browser and accesses the other elogd server. Since SSL is not built into elogd, it can only use the http protocol, not https. If you want secure synchronization, the only chance you have is to make a SSH tunnel on which you run the http protocol for synchronization.
  2126   Tue Feb 13 15:11:18 2007 Question Marcus Hausermhauser@lsw.uni-heidelberg.deQuestionLinux2.6.3-1762Re: Synchronization using https

Stefan Ritt wrote:

Alexandre Lindote wrote:
Now we want to have several servers set up (in different institutions), and have them synchronized automatically.


Synchronization works such that the "client" elogd (the one on which the synchronization is started) "emulates" a browser and accesses the other elogd server. Since SSL is not built into elogd, it can only use the http protocol, not https. If you want secure synchronization, the only chance you have is to make a SSH tunnel on which you run the http protocol for synchronization.



Would it be possible to use rsync to syncronise two elogd servers on different servers via secure synchronization on the file level?
E.g.
rsync -av -e ssh /var/lib/elog/logbooks/ elog.remote.de:/var/lib/elog/logbooks/
  2127   Tue Feb 13 15:36:08 2007 Reply Stefan Rittstefan.ritt@psi.chQuestionLinux2.6.3-1762Re: Synchronization using https

Marcus Hauser wrote:
Would it be possible to use rsync to syncronise two elogd servers on different servers via secure synchronization on the file level?
E.g.
rsync -av -e ssh /var/lib/elog/logbooks/ elog.remote.de:/var/lib/elog/logbooks/


Do do this, you have to do the following:

  • Stop both elogd servers on each side
  • Do the rsync
  • Restart the elogd servers

This is necessary because an elogd server does not rescan the database files unless it's restarted. Note that you only can synchronize on a day level. Like if in a single day new entries are made on both sides, you have a conflict. This is not the case if you do the internal elogd synchronization, because this works on an entry level (actually that was the reason why this internal synchronization was invented). So new entries on both sides which were made as the same day will be merged intelligently.
  2313   Fri Sep 7 22:31:10 2007 Reply Stefan Rittstefan.ritt@psi.chQuestionLinux2.6.5Re: Synchronization Problems

Nicole Ackerman wrote:
I'm currently running elog 2.6.5 on my (feisty ubuntu) laptop and desktop. I set up mirroring between the two which usually works, but occasionally I get an error (when sending from laptop to desktop) :

"Enty too long to display. Please increase TEXT_SIZE and recompile elogd."

When this happens my entry is shortened to 3 characters. This is frustrating as I have lost many important entries. I'm unsure why this is happening - they aren't the longest entries in my logbook (one was a one line linux command) and there doesn't seem to be anything "special" about the ones that do and do not sync. The last time I tried to sync I got this error on 3 entries and they appear to be corrupted - when I try to access them elogd stops responding.

On a presumably related note, every time I try to send an entry from my laptop to my desktop I get "Error sending local entry: Error transmitting message", though the entry has appeared to sync properly. I don't think I have ever had a problem transmitting from my desktop to my laptop.

Currently the only mirroring option I have added to my config file in on my laptop which is the IP of my desktop as the Mirror server.

I'm unsure what else I could post to help troubleshoot this problem - is it just something I've done wrong or that could be fixed with a reinstall?


I'm sorry for your trouble. The key to understand and fix this problem is reproducibility. Can you identify an entry which causes this error (of course back up the entry before trying). Then create a fresh logbook where you put only this entry. If you can reproduce the problem, can you send me that entry, together with your config files? Only if I can reproduce your problem, I can fix it.

Best regards,

Stefan
  65923   Thu Jul 10 12:46:52 2008 Reply Stefan Rittstefan.ritt@psi.chQuestionWindows2.7.3-2104Re: Synchronising between physically separate networks

Dougie Mooney wrote:

Hi there. Just started recently set up the application and think its very usable and easily configured - great stuff

I'm looking to roll it out to the masses but have a slight logistical problem in that we work on 2 separate networks - NET1 with connection to the internet, and NET2 physically isolated from NET1 and the internet.

It would be desirable to allow users to add/update/delete logs from both NET1 and NET2 with periodic synchronisation.

I believe the mirroring facility is what should be used, and think the following setup and synchronisation steps may be workable:

Setup:

  • elog installed on node of NET1
  • elog installed on 2 nodes of NET2
  • elog server running on NET1 and node1 of NET2 both using a common elogd.cfg

Performing Synchronisation:

  1. Stop the server on NET1
  2. copy logbook directories from NET1 to node2 of NET2
  3. start server on node2 of NET2 using the -M option
  4. once above complete, copy logbook directories from node 2 NET2 to NET1
  5. Start the server on NET1

Am I on the right track?

Would very much appreciate comments and and advice on the above.

 A couple of comments:

  • In principle you could use one elogd.cfg for two running daemons, but only if they do not modify the file. If you use "extensible attributes" for example, you would have write access. If this happens from both servers at the same time, the config file can get corrupt. This is even more true with a password file, which gets written every time a users accesses a page. If you only run one server at a time, then they can share the config file of course.
  • The synchronization works bi-directional between two elog daemons. Requirement is that they have access to each other. The synchronization master acts like a "browser" to the slave to send/retrieve entries. So if you can affort punching a hole into your firewall between NET1 and NET2, you could synchronize two servers directly and don't have to bother with three servers. If you have however really physically separated nets, such that you need a memory stick to transport data from one net to the other, then indeed you need the above described scenario. I never tried it in this way, but in principle it should work.
  66369   Thu Jun 4 14:04:21 2009 Reply Stefan Rittstefan.ritt@psi.chQuestionLinux2.7.6-2198Re: Supress Email to Author of a message?

 

Mike wrote:

I couldn't find an obvious solution to the problem. I'd like to suppress email

notification to the author of a message. I've had some people complaining

that when they use elog they don't want to get an email about what they wrote

since they wrote it.


Is it possible?

 

Actually I do want to receive a copy, just to be sure that the emails got sent out correctly. I agree that an option would be good for that but it's not implemented right now. An alternative solution is to define a filter in their email client to discard these messages (like if subject contains ELOG and sender equals your own mail address).

  66541   Thu Sep 10 16:55:08 2009 Reply Stefan Rittstefan.ritt@psi.chQuestionWindows2.7.5-2185Re: Supress Email on Reply

mike cianci wrote:

The way I have ELOG configured it sends an email to supervisors based on which "Department " (attribute) was selected. Problem is that when the supervisor replies the department

is still selected and it sends a second email to the supervisor. Is there any way to supress the emails (automatically) on "Reply"?

No, but you can remove the "Department" with

Remove on reply = Department

this way the attribute vanishes, but that should be ok since you always have the link to the original entry which contains the department. 

ELOG V3.1.5-3fb85fa6