Re: Parallel building/compiling

On Mar 30, 3:00 pm, Ian Collins <ian-n...@xxxxxxxxxxx> wrote:
Tarkin wrote:
Hi all,

I got to musing just now, after watching the
output of VICE being made, and recalled something
about GNU 'make' being optimized for 'parallel' builds.

Is parallel building like compiling separate object
files on different machines, at the same time?

No, that's distributed building. Parallel building is building more
than one target on the same machine, which is what the gnu make -J
option does.

If so, what are the various techniques for the final link?
Do the get sent to some central/master machine to
be held until they are all present, and then linked?

That's an implementation detail. The cleanest way is to use a common
(NFS mounted) output directory. The make tool knows the dependency
tree, so it can schedule jobs in the most efficient order.

Are there 'build farms', like 'render farms'?

Yes, I use one. Some tools (I use Sun dmake) provide support for
distributed as well as parallel building.

--
Ian Collins.

Parallel building is building more
than one target on the same machine, which is what the gnu make -J
option does.

Ahhh...I see.

Distributed building is what I was thinking of.
Amazing.

What do you (and others, please feel free to chime in)
make on the farm? Something complex, I would imagine.
If you don't mind my asking, of course.

Off to google I go...

Thank you and TTFN,
Tarkin
.

Relevant Pages

  • Re: kbuild: Problem with latest GNU make rc
    ... delved into the kbuild infrastructure and I found the problem. ... changes for a given target (normally make only rebuilds if the target is ... .KEEP_STATE feature but GNU make does not support this). ... is the changed prerequisites; it'll be ...
    (Linux-Kernel)
  • Re: make picks wrong target: why?
    ... associated with that version of GNU make? ... ff> dependencies no matter which target I ask for. ... ff> to prevent a random object file from becoming the default target. ... the makefilelisted on the command line AND ANY MAKEFILES INCLUDED ...
    (comp.unix.programmer)
  • GNU Makefile with phony target and source files as dependencies of a target
    ... I have a question about GNU make running on the Solaris 8 platform. ... We have a GNU Makefile which has a "depend" target (for the usual ... in that the prep target (along with the ... and so the CC command to generate ...
    (comp.unix.shell)
  • GNU Makefile with phony target and source files as dependencies of a target
    ... I have a question about GNU make running on the Solaris 8 platform. ... We have a GNU Makefile which has a "depend" target (for the usual ... in that the prep target (along with the ... and so the CC command to generate ...
    (comp.unix.programmer)
  • Re: Make fails in 4.8
    ... On Thu, 2003-09-25 at 15:07, Harold A. Mackey wrote: ... > make: no target to make. ... Double-check that your path isn't putting GNU make in front of ...
    (freebsd-stable)