The FX Special Effects Image Operator • The Anatomy of an FX Expression
The FX special effects image operator applies a mathematical expression to each pixel channel of an image. The FX expression language provides a powerful and flexible way to manipulate images, allowing you to perform a wide range of operations and transformations on your images. Use FX to:
- create canvases, gradients, mathematical colormaps
- move color values between images and channels
- translate, flip, mirror, rotate, scale, shear and generally distort images
- merge or composite multiple images together
- convolve or merge neighboring pixels together
- generate image metrics or 'fingerprints'
The operator loops through all the pixels of an image and all the channels of each pixel and returns a new image with the results. The expression can reference any image in the image sequence, but only a copy of the first image is returned with suitable updates per your expression.
The expression can be simple:
magick -size 64x64 canvas:black -channel blue -fx "1/2" fx_navy.png
Here, we convert a black to a navy blue image:
Or the expression can be complex:
magick rose: \ -fx "(1.0/(1.0+exp(10.0*(0.5-u)))-0.006693)*1.0092503" \ rose-sigmoidal.png
This expression results in a high contrast version of the source image:
The expression can include variable assignments. Assignments, in most cases, reduce the complexity of an expression and permit some operations that might not be possible any other way. For example, lets create a radial gradient:
magick -size 70x70 canvas: \ -fx "Xi=i-w/2; Yj=j-h/2; 1.2*(0.5-hypot(Xi,Yj)/70.0)+0.5" \ radial-gradient.png
The command above returns this image:
This FX expression adds random noise to an image:
magick photo.jpg -fx 'iso=32; rone=rand(); rtwo=rand(); \ myn=sqrt(-2*ln(rone))*cos(2*Pi*rtwo); myntwo=sqrt(-2*ln(rtwo))* \ cos(2*Pi*rone); pnoise=sqrt(p)*myn*sqrt(iso)* \ channel(4.28,3.86,6.68)/255; max(0,p+pnoise)' noisy.png
This FX script utilizes a loop to create a Julia set:
magick -size 400x400 xc:gray -fx " \ Xi=2.4*i/w-1.2; \ Yj=2.4*j/h-1.2; \ for (pixel=0.0, (hypot(Xi,Yj) < 2.0) && (pixel < 1.0), \ delta=Xi^2-Yj^2; \ Yj=2.0*Xi*Yj+0.2; \ Xi=delta+0.4; \ pixel+=0.00390625 \ ); \ pixel == 1.0 ? 0.0 : pixel" \ \( -size 1x1 xc:white xc:red xc:orange xc:yellow xc:green1 xc:cyan xc:blue \ xc:blueviolet xc:white -reverse +append -filter Cubic -resize 1024x1! \) \ -clut -rotate -90 julia-set.png
This FX script prints the first 10 prime numbers:
magick xc:gray -fx " \ for (prime=2, prime < 30, composite=0; \ for (nn=2, nn < (prime/2+1), if ((prime % nn) == 0, composite++, ); nn++); \ if (composite <= 0, debug(prime), ); prime++)" null:
See Using FX, The Special Effects Image Operator for more examples.
The -fx option replaces any image sequence with a clone of the first image updated with the results of the expression. If you prefer to apply the expression to each image in the sequence, use +fx instead.
The FX expression is interpretted in a single-thread, however, it is executed in multiple threads unless the expression includes the debug()
function.
The next section discusses the FX expression language.
The Anatomy of an FX Expression
The FX Expression Language
The formal FX expression language is defined here:
- numbers:
- integer, floating point, scientific notation (+/- required, e.g. 3.81469e-06), International System number postfixes (.e.g KB, Mib, GB, etc.)
- constants:
- E (Euler's number), Epsilon, Opaque, Phi (golden ratio), Pi, QuantumRange, QuantumScale, Transparent
- FX operators (in order of precedence):
- ^ (power), unary -, *, /, % (modulo), +, -, <<, >>, <, <=, >, >=, +=, -=, *=, /=, %=, <<= , >>=, &=, |=, ++, --, ==, !=, & (bitwise AND), | (bitwise OR), && (logical AND), || (logical OR), ~ (logical NOT), ?: (ternary conditional)
- array:
- an image offers array storage (e.g. p[-1,-1].r) bounded by its width and height. An image sequence represents multiple arrays (e.g. u.p[0,0].r, v.p[0,0].r). Storage is limited to Quantum values, e.g. [0..65535] for Q16 builds and floating point for HDRI-enabled builds.
- math functions:
- abs(), acos(), acosh(), airy(), alt(), asin(), asinh(), atan(), atanh(), atan2(), ceil(), clamp(), cos(), cosh(), debug(), drc(), erf(), exp(), floor(), gauss(), gcd(), hypot(), int(), isnan(), j0(), j1(), jinc(), ln(), log(), logtwo(), max(), min(), mod(), not(), pow(), rand(), round(), sign(), sin(), sinc(), sinh(), sqrt(), squish(), tan(), tanh(), trunc()
- channel functions:
- define up to 5 pixel channels
- color names:
- red, cyan, black, etc.
- color functions:
- srgb(), srgba(), rgb(), rgba(), cmyk(), cmyka(), hsl(), hsla(), etc.
- color hex values:
- #ccc, #cbfed0, #b9e1cc00, etc.
- symbols:
- u: first image in list
- v: second image in list
- s: current image in list (for %[fx:] otherwise = u)
- t: index of current image (s) in list
- n: number of images in list
- i: column offset
- j: row offset
- p: pixel to use (absolute or relative to current pixel)
- w: width of this image
- h: height of this image
- z: channel depth
- r: red value (from RGBA), of a specific or current pixel
- g: green
- b: blue
- a: alpha
- o: opacity
- c: cyan value of CMYK color of pixel
- y: yellow
- m: magenta
- k: black
- all: all channels
- this: this channel
- intensity: pixel intensity
- hue: pixel hue
- saturation: pixel saturation
- lightness: pixel lightness
- luma: pixel luma
- page.width: page width
- page.height: page height
- page.x: page x offset
- page.y: page y offset
- printsize.x: x printsize
- printsize.y: y printsize
- resolution.x: x resolution
- resolution.y: y resolution
- depth: image depth
- extent: image extent
- minima: image minima
- maxima: image maxima
- mean: image mean
- median: image median
- standard_deviation: image standard deviation
- kurtosis: image kurtosis
- skewness: image skewness (add a channel specifier to compute a statistic for that channel, e.g. depth.r)
- iterators:
- do(), for(), while()
- image attributes:
- s.depth, s.kurtosis, s.maxima, s.mean, s.minima, s.resolution.x, s.resolution.y, s.skewness, s.standard_deviation
- user settings:
- define Fx symbols as user settings, e.g.
magick ... -set option:wd1 "%[fx:w/2]" -resize "%[fx:wd1-5]" ...
The FX Expression
An FX expression may include any combination of the following:
- x ^ y
- exponentiation (x^{y})
- ( ... )
- grouping
- x * y
- multiplication
- x / y
- division
- x % y
- modulo
- x + y
- addition
- x - y
- subtraction
- x << y
- left shift
- x >> y
- right shift
- x < y
- boolean relation, return value 1.0 if x < y, otherwise 0.0
- x <= y
- boolean relation, return value 1.0 if x <= y, otherwise 0.0
- x > y
- boolean relation, return value 1.0 if x > y, otherwise 0.0
- x >= y
- boolean relation, return value 1.0 if x >= y, otherwise 0.0
- x == y
- boolean relation, return value 1.0 if x == y, otherwise 0.0
- x != y
- boolean relation, return value 1.0 if x != y, otherwise 0.0
- x & y
- binary AND
- x | y
- binary OR
- x && y
- logical AND connective, return value 1.0 if x > 0 and y > 0, otherwise 0.0
- x || y
- logical OR connective (inclusive), return value 1.0 if x > 0 or y > 0 (or both), otherwise 0.0
- ~x
- logical NOT operator, return value 1.0 if not x > 0, otherwise 0.0
- +x
- unary plus, return 1.0*value
- -x
- unary minus, return -1.0*value
- condition ? true-statements : false-statements
- ternary conditional expression, return value true-statements if condition != 0, otherwise false-statements
- x = y
- assignment; single character variables are reserved, instead use 2 or more characters, letter combinations only (e.g. Xi not X1)
- x ; y
- statement separator
- phi
- constant (1.618034...)
- pi
- constant (3.14159265359...)
- e
- constant (2.71828...)
- QuantumRange
- constant maximum pixel value (255 for Q8, 65535 for Q16)
- QuantumScale
- constant 1.0/QuantumRange
- intensity
- pixel intensity whose value respects the -intensity option.
- hue
- pixel hue
- saturation
- pixel saturation
- lightness
- pixel lightness; equivalent to 0.5*max(red,green,blue) + 0.5*min(red,green,blue)
- luminance
- pixel luminance; equivalent to 0.212656*red + 0.715158*green + 0.072186*blue
- red, green, blue, etc.
- color names
- #ccc, #cbfed0, #b9e1cc00, etc.
- color hex values
- rgb(), rgba(), cmyk(), cmyka(), hsl(), hsla()
- color functions
- s, t, u, v, n, i, j, w, h, z, r, g, b, a, o, c, y, m, k
- symbols
- abs(x)
- absolute value function
- acos(x)
- arc cosine function
- acosh(x)
- inverse hyperbolic cosine function
- airy(x)
- Airy function (max=1, min=0); airy(x)=[jinc(x)]^{2}=[2*j1(pi*x)/(pi*x)]^{2}
- alt(x)
- sign alternation function (return 1.0 if int(x) is even, -1.0 if int(x) is odd)
- asin(x)
- arc sine function
- asinh(x)
- inverse hyperbolic sine function
- atan(x)
- arc tangent function
- atanh(x)
- inverse hyperbolic tangent function
- atan2(y,x)
- arc tangent function of two variables
- ceil(x)
- smallest integral value not less than argument
- channel(...)
- supports from zero to five arguments, e.g., channel(0.1) sets the first channel to 0.1 and zero's the other channels.
- clamp(x)
- clamp value
- cos(x)
- cosine function
- cosh(x)
- hyperbolic cosine function
- debug(x)
- print x (useful for debugging your expression)
- do(statements, condition)
- iterate while the condition is not equal to 0
- drc(x,y)
- dynamic range compression (knee curve); drc(x,y)=(x)/(y*(x-1)+1); -1<y<1
- erf(x)
- error function
- exp(x)
- natural exponential function (e^{x})
- floor(x)
- largest integral value not greater than argument
- for(initialize, condition, statements)
- iterate while the condition is not equal to 0
- gauss(x)
- gaussian function; gauss(x)=exp(-x*x/2)/sqrt(2*pi)
- gcd(x,y)
- greatest common denominator
- hypot(x,y)
- the square root of x^{2}+y^{2}
- if(condition, nonzero-statements, zero-statements)
- interpret expression depending on condition
- int(x)
- greatest integer function (return greatest integer less than or equal to x)
- isnan(x)
- return 1.0 if x is NAN, 0.0 otherwise
- j0(x)
- Bessel functions of x of the first kind of order 0
- j1(x)
- Bessel functions of x of the first kind of order 1
- jinc(x)
- jinc function (max=1, min=-0.1323); jinc(x)=2*j1(pi*x)/(pi**x)
- ln(x)
- natural logarithm function
- log(x)
- logarithm base 10
- logtwo(x)
- logarithm base 2
- ln(x)
- natural logarithm
- max(x, y)
- maximum of x and y
- min(x, y)
- minimum of x and y
- mod(x, y)
- floating-point remainder function
- not(x)
- return 1.0 if x is zero, 0.0 otherwise
- pow(x,y)
- power function (x^{y})
- rand()
- value uniformly distributed over the interval [0.0, 1.0) with a 2 to the 128th-1 period
- round()
- round to integral value, regardless of rounding direction
- sign(x)
- return -1.0 if x is less than 0.0 otherwise 1.0
- sin(x)
- sine function
- sinc(x)
- sinc function (max=1, min=-0.21); sinc(x)=sin(pi*x)/(pi*x)
- squish(x)
- squish function; squish(x)=1.0/(1.0+exp(-x))
- sinh(x)
- hyperbolic sine function
- sqrt(x)
- square root function
- tan(x)
- tangent function
- tanh(x)
- hyperbolic tangent function
- trunc(x)
- round to integer, towards zero
- while(condition, statements)
- iterate while the condition is not equal to 0
- image.depth, image.kurtosis, image.maxima, image.mean, image.median, image.minima, image.resolution.x, image.resolution.y, image.skewness, image.standard_deviation
- image attributes
The expression semantics include these rules:
- symbols are case insensitive
- only one ternary conditional (e.g. x ? y : z) per statement
- statements are assignments or the final expression to return
- an assignment starts a statement, it is not an operator
- single character variables are reserved. Assignments to reserved built-ins throw an exception; e.g. r=3.0; r returns Attempted assignment to non-UserSymbol 'r' at '3.0'.
- unary operators have a lower priority than binary operators, that is, the unary minus (negation) has lower precedence than exponentiation, so -3^2 is interpreted as -(3^2) = -9. Use parentheses to clarify your intent (e.g. (-3)^2 = 9).
- care must be exercised when using the slash ('/') symbol. The string of characters 1/2x is interpreted as (1/2)x. The contrary interpretation should be written explicitly as 1/(2x). Again, the use of parentheses helps clarify the meaning and should be used whenever there is any chance of misinterpretation.
- As -- is the variable decrement operator, use parenthesis to subtract a negative number, e.g, -4-(-5).
Source Images
The symbols u and v refer to the first and second images, respectively, in the current image sequence. Refer to a particular image in a sequence by appending its index to any image reference (usually u), with a zero index for the beginning of the sequence. A negative index counts from the end. For example, u[0] is the first image in the sequence, u[2] is the third, u[-1] is the last image, and u[t] is the current image. The current image can also be referenced by s. If the sequence number exceeds the length of the sequence, the count is wrapped. Thus in a 3-image sequence, u[-1], u[2], and u[5] all refer to the same (third) image.
As an example, we form an image by averaging the first image and third images (the second (index 1) image is ignored and just junked):
magick image1.jpg image2.jpg image3.jpg -fx "(u+u[2])/2" image.jpg
By default, the image to which p, r, g, b, a, etc., are applied is the current image s in the image list. This is equivalent to u except when used in an escape sequence %[fx:...].
It is important to note the special role played by the first image. This is the only image in the image sequence that is modified, other images are used only for their data. As an illustrative example, consider the following, and note that the setting -channel red instructs -fx to modify only the green channel; nothing in the red or blue channels will change. It is instructive to ponder why the result is not symmetric.
magick logo: -flop logo: -resize "20%" -channel green -fx "(u+v)/2" image.jpg
Accessing Pixels
All color values are normalized to the range of 0.0 to 1.0. The alpha channel ranges from 0.0 (fully transparent) to 1.0 (fully opaque).
The pixels are processed one at a time, but a different pixel of an image can be specified using a pixel index represented by p. For example,
p[-1].g green value of pixel to the immediate left of the current pixel p[-1,-1].r red value of the pixel diagonally left and up from current pixel
To specify an absolute position, use braces, rather than brackets.
p{0,0}.r red value of the pixel in the upper left corner of the image p{12,34}.b blue pixel value at column number 12, row 34 of the image
Integer values of the position retrieve the color of the pixel referenced, while non-integer position values return a blended color according to the current -interpolate setting.
A position outside the boundary of the image retrieves a value dictated by the -virtual-pixel option setting.
Specify u.r to specify the red channel of the current image. If you don't specify a channel qualifier, you get the current channel. Use mean.this to set the output channel to the mean of just the input channel. Use mean.all to set the overall mean of the input channels.
Apply an Expression to Select Image Channels
Use the -channel setting to specify the output channel of the result. If no output channel is given, the result is set over all channels except the opacity channel. For example, to replace the red channel of alpha.png with the average of the green channels from the images alpha.png and beta.png, use:
magick alpha.png beta.png -channel red -fx "(u.g+v.g)/2" gamma.png
Results
The -fx operator evaluates the given expression for each channel (set by -channel) of each pixel in the first image (u) in the sequence. The computed values are temporarily stored in a copy (clone) of that first image until all the pixels have been processed, after which this single new image replaces the list of images in the current image sequence. As such, in the previous example the updated version of alpha.png replaces both of the original images, alpha.png and beta.png, before being saved as gamma.png.
The current image s is set to the first image in the sequence (u), and t to its index, 0. The symbols i and j reference the current pixel being processed.
For use with -format, the value-escape %[fx:] is evaluated just once for each image in the current image sequence. As each image in the sequence is being evaluated, s and t successively refer to the current image and its index, while i and j are set to zero, and the current channel set to red (-channel is ignored). An example:
$ magick canvas:'rgb(25%,50%,75%)' rose: -colorspace gray \ -format 'Red channel of NW corner of image #%[fx:t] is %[fx:s]\n' info: Red channel of NW corner of image #0 is 0.464883 Red channel of NW corner of image #1 is 0.184582
Here we use the image indexes to rotate each image differently, and use -set with the image index to set a different pause delay on the first image in the animation:
magick rose: -duplicate 29 -virtual-pixel Gray -distort SRT '%[fx:360.0*t/n]' \ -set delay '%[fx:t == 0 ? 240 : 10]' -loop 0 rose.gif
This example tests the difference between two images, measured by RMSE. If the difference is greater than 0.1 it returns 1; otherwise it returns 0:
magick water.png reference.png -metric RMSE -compare -format "%[fx:%[distortion]>0.1]" info:
The color-escape %[pixel:] or %[hex:] is evaluated once per image and per color channel in that image (-channel is ignored), The values generated are then converted into a color string (a named color or hex color value). The symbols i and j are set to zero, and s and t refer to each successively current image and index.