Re: design of analog circuits using genetic algorithm

On Thu, 13 Mar 2008 01:31:02 -0700 (PDT), Martin Brown
<|||newspam|||@nezumi.demon.co.uk> wrote:

In message <04tdt3196l9ufhhuapfkum7dl6r0mdb4dq@xxxxxxx>, John Larkin
<jjlarkin@highNOTlan
dTHIStechnologyPART.com> writes
On Tue, 11 Mar 2008 12:05:24 -0700, "Joel Koltner"
<zapwireDASHgroups@xxxxxxxxx> wrote:

"John Larkin" <jjlarkin@xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx> wrote in message
news:0cldt3hl9rrp0llh7hp7l79lk58jibvna9@xxxxxxxxxx
People, mostly academics, keep trying this. As far as I know, it
doesn't work. Understanding electronics is still better than random
fiddling; the solution spaces, first for a topology and then for
values, is just too big.

I believe you were the one telling us you're personally much more than just a
giant genetic algorithm yourself though, right, John? :-)

Somehow a few trillion neurons work better than a few thousand lines
of code. Maybe some day computers will be better than people for
circuit design, like they are now for chess. But chess has rules.

And so does circuit design.

Does it? What machine-executable rules would create the schematic of,
say, a spectrum analyzer, or a cell phone, or a laser printer?

Although the intuitive creative step to
define the overall circuit architecture is still well
beyond modern computation power optimising component values in an
existing design is now quite
practicable even on a PC given enough time.

As far as I've heard, only trivial circuits can be optimized by
evolutionary techniques, and some produce (and publish!) preposterous
results. Some things, like filters, can be successfully diddles, but
only starting from a very-close-to-working initial design.


I agree with you, although I will point out for the benefit of the O.P. that
using optimizers (genetic algorithms or more traditional ones) to *tweak*
component values once you have a decent toplogy and reasonably sane starting
values is quite common and successful.

Have you done genetic optimization of circuit values? I guess you'd
first have to come up with a scoring system that defines "best" (like,
for a voltage regulator, something that includes line reg, load reg,
tc, transient response, standard value parts, cost? Then wrap around
that a simulator, then wrap around that the random value diddler and
genetic selection stuff. I can see that diverging fast. Or rather,
diverging slow. It's easy to get lost in a 17-dimensional space.

17 dimensions is no real challenge to modern optimisers.

No modern least squares (or 1-Norm) optimiser should ever diverge (and
that was true of the good ones even a couple of decades ago). What
tends to happen is that they get trapped in steep diagonal valleys or
at local minima and never find the true global optimum. The solution
should never be worse than the initial guess.

Where did that initial guess come from? Where did the circuit topology
come from?


Simplex isn't too bad if you already have some idea of how big a range
of parameter space you have to cover. Conjugate gradients will handle
the most difficult problems fairly well given a suitable starting
point and something like simulated annealing is about as good as it
gets for global optimisation irrespective of the initial starting
point. Genetic algorithms are similar to the latter, but rely on an
ensemble of simulations with parameters that are allowed to breed
according to their success rating. They are harder to make work than
simulated annealing codes though fun to watch on toy problems. I
reckon simulated annealing is easier to use than GA. YMMV.

You are talking about minor tweaking of the values of a network that
already exists and is close to the desired performance. That's not
circuit design, that's a tiny, specialized piece of it.

John


.

Relevant Pages

  • Re: design of analog circuits using genetic algorithm
    ... circuit design, like they are now for chess. ... Although the intuitive creative step to define the architecture is still well beyond modern computation optimising components in an existing architecture is now quite practicable even on a PC. ... Conjugate gradients will handle most difficult problems fairly well given a suitable starting point and something like simulated annealing is about as good as it gets for global optimisation irrespective of the initial starting point. ... Genetic algorithms are similar to the latter, but rely on an ensemble of simulations with parameters that are allowed to breed according to their success rating. ...
    (sci.electronics.design)
  • Re: design of analog circuits using genetic algorithm
    ... And so does circuit design. ... beyond modern computation power optimising component values in an ... using optimizers (genetic algorithms or more traditional ones) to *tweak* ... simulated annealing codes though fun to watch on toy problems. ...
    (sci.electronics.design)
  • Scheme UK Meeting: 23 June 2004
    ... This meeting is not held on the usual date, ... Circuit Design in Lava ... Satnam Singh, of Microsoft, will present a circuit design ... formal methods and programming languages. ...
    (comp.lang.lisp)
  • Re: Adapting An Electrophoresis HVDC Power Supply To Microampere Level
    ... expert in circuit design, but he could not give much time to it and wrote a ... or building something on a circuit board ... a variable resistor to be used for that adjusting, ... going to need a voltage sequencer from 500V to 10KV. ...
    (sci.electronics.design)
  • Re: how to learn low level RF design
    ... knowledge of analog and digital electronics and have worked on a very ... I have always wanted to learn low level RF "black art" circuit design, ... If your talking HF radio below 100Mhz, ...
    (sci.electronics.design)