SVN infrastructure woes

Hi,

I noticed that recently our bots have been failing more than usual on
SVN connection problems:

Updating ‘.’:
svn: E175002: Unable to connect to a repository at URL
http://llvm.org/svn/llvm-project/lnt/trunk
svn: E175002: Server sent unexpected return value (502 Bad Gateway) in
response to OPTIONS request for
http://llvm.org/svn/llvm-project/lnt/trunk

Is there anything going on with the server?

cheers,
--renato

Is there anything going on with the server?

llvm.org seemed to be completely down this morning. It came up again
around 1127 (UTC+1).

Thanks,
Dan.

Yes, and this seems to be going on for quite a few weeks already.
Maybe we need to be using the git mirror for the bots?

cheers,
--renato

git mirror is located on llvm.org as well... :slight_smile:

d'oh!

Should we start planning a wider infrastructure with separate servers
for separate functionality?

Seems like we're putting all our eggs, apples and oranges in the same basket.

cheers,
--renato

Well, right now with git mirror on llvm.org we're having a luxury of
sync'ing via file:// directly in post-commit hook.

Maybe we should replicate the mirror, this looks like a better approach.

I meant having multiple servers for different services. SVN and Git
can still live in the same server, but the website, Perf, buildmaster
could have their own instances so that one did not affect the other.
Given that we can still cope with the traffic, having cloud instances
of each would be enough to separate while allowing us to scale
independently.

--renato

I believe infrastructure issues of this nature have been discussed at LLVM Foundation meetings. We’ll see how it plays out.

But I don't think there's a reason we couldn't point the bots at the git
*hub* mirrors. I'm not sure if they lag the official mirror though.

But I don't think there's a reason we couldn't point the bots at the github
mirrors. I'm not sure if they lag the official mirror though.

The GitHub mirrors located at [1] are updated hourly which is not
frequent enough

There seems to be an LLVM organisation registered on GitHub but it
doesn't seem to be in use.

[1] https://github.com/llvm-mirror/
[2] https://github.com/llvm/

Who runs https://github.com/llvm-mirror/ ? FWIW, I usually use Takumi’s repos when pulling from github (https://github.com/chapuni)

– Sean Silva

I think pointing the bots at any mirror is a horrible idea. If the master or the syncing fails the bots will just sit idle. At least right now, errors pour out and action is taken.

The best solution here is to make the master better, either by setting up a more robust setup, or using a service.

I don't know, but it doesn't seem up-to-date enough for buildbots or
even general development...

--renato

+1

--renato

Chris,

Official git mirror is a bit special. It's updated on server side via
SVN post-commit hook. But I agree, we need to somehow have repos and
web stuff be separate.