AIPS++ Site Nov-Mar Apr-Oct
New South Wales +11:00 +10:00
Netherlands +01:00 +02:00
Universal Time 00:00 00:00
Virginia -05:00 -04:00
Illinois -06:00 -05:00
New Mexico -07:00 -06:00
Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

AIPS++ and the Green Bank Telescope
Jim Braatz - NRAO, Green Bank

The final stage of construction on the GBT entails setting the surface panels, and as of late January 2000 about 75% were in place. It is anticipated that NRAO will accept the telescope in the Summer of 2000. After acceptance, there will be a testing and commissioning phase which will last through about the end of the year. As the GBT antenna is taking form, so is the software associated with the operation of the telescope. AIPS++ is being used widely in the project for the development of engineering analysis tools, the observer's interface, and commissioning tools. In addition, astronomers will do their analysis work using DISH, an AIPS++ tool for single-dish data reduction (see the February 1999 article by Bob Garwood.)

The electronics systems for the telescope have been undergoing testing in a "mock-up" which includes the receivers, LO systems, analog filters, and the backends. In December 1999, the monitor and control software and the observer's interface were incorporated into these tests for the first time. The tests had the look and feel of a real observing experience with the GBT. Cross scans through a series of radio sources were simulated with the Digital Continuum Receiver (DCR) being used as the backend. In January 2000, similar integrated-system testing was done using the spectral processor as the backend. These procedures are ongoing and continue to be useful in identifying how the software can be optimized.

During the tests, the data were filled into a Measurement Set using a new on-line filler and then custom AIPS++ tools were used to conduct the analysis. The DCR data, for example, were analyzed using the commissioning tool, which is the AIPS++ software to be used for measuring system performance and analyzing continuum data during the GBT's commissioning phase. Specifically, the commissioning tool will calculate system and antenna temperatures, pointing offsets, focus parameters, tracking stability, and tipping curves. The software continues in a development phase as testing points to procedures which will be required during the actual commissioning. The tool uses a custom GUI built in Glish/Tk, though all of the functionality is available from the command line interface as well. The infrastructure of DISH is built into the commissioning tool, so many of the techniques translate readily between the two tools. Figure 1 shows the Commissioning Tool GUI and Figure 2 shows some results of a simulated cross scan plotted on the DISH plotter.


Figure 1: Commissioning Tool GUI


Figure 2: Simulated Cross Scan Plotted on the DISH Plotter

GBT engineers have been building custom Glish tools for testing of individual electronics components, as well. The ease with which Glish/Tk GUIs can be created and the ability to manipulate data quickly and easily are a great asset to the engineers working these tests. The scope of the applications ranges from checking the noise characteristics of the receivers to tracing the power pulled by the motors as the antenna is moved. Figure 3 shows an example of one of the DCR engineering tools; Figure 4, the total power seen by two different channels is plotted against time.


Figure 3: Example of a DCR Engineering Tool



Figure 4: Total Power seen by Two Different Channels vs. Time

The accuracy of the GBT surface will ultimately rely on the metrology system, but initially the shape of the surface will be measured and adjusted using more traditional holography techniques. The holographic measurements have an expected accuracy of less than 0.1 mm RMS. Tests of the holography receiver and backend were completed this past summer using the 140-ft telescope, and the data have been ingested into AIPS++. Existing UNIPOPS scripts have been converted into Glish, and now the full suite of AIPS++ analysis techniques and data display programs are available. A feature of the AIPS++ viewer which has been particularly useful in this work is its deft handling of complex arrays. Figure 5 shows a set of data taken in 1986 with the 140-ft telescope and displayed with the AIPS++ viewer. The top frame shows the illumination pattern on the dish seen by the feed, and the bottom frame shows the surface deviation from parabolic. A reference panel about 1 mm in thickness was placed on the dish and can be seen at 12 o'clock, halfway between the center and edge.


Figure 5:
Top: Illumination Pattern on the Dish as seen by the Feed
Bottom: Surface Deviation from Parabolic

Times are exciting in Green Bank, and the AIPS++ project looks to play a vital role in the success of the GBT. The GBT-specific work described in this article can be credited primarily to Roger Norrod, Joe McMullin, Bob Garwood, Ron Maddalena, and Dana Balser.


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

Glish as a Scripting Language
Darrell Schiebel - NRAO, Charlottesville

At the recent ADASS IX Conference, a major theme was combining scripting with compiled languages to arrive at flexible data processing systems. This was of particular interest to those involved with AIPS++ because it confirms that the general approach we adopted in 1994 was the right one. This and future articles discuss why this approach is fruitful along with comparisons of scripting languages currently in use.

The three key reasons why this development path was chosen for AIPS++ is because it allows:

  • users to develop their own applications;
  • rapid prototyping by both developers and users; and
  • the language and the project to develop together.

One of the primary goals of AIPS++ is to allow users to develop their own applications. This goal is not easy to fulfill. There will always be users who can make their applications work even under the most trying of circumstances, but a large toolkit can elevate the level of interaction so that users can manipulate components which are conceptually closer to the types of objects which they understand. Too many systems force users to understand the low-level details of the system. This has ramifications at many levels. At the most basic level, the user would like an interactive way to see function options rather than having to know the parameters (and perhaps global variables!) which a function uses. At a higher level, the user would like to interact with images rather than having to know details about how the image is stored. The availability of a scripting language is the gateway, since it allows a user to write scripts which utilize major components without requiring that the user understand the low-level details of these components. To be sure, the user must understand the component, but for it to be beneficial, the level of the interaction must be close to the level with which the user is comfortable.

The second goal is related to the first; having a scripting language that allows users to interact with components, also achieves the bonus of having a way for developers to prototype applications. The key is to have a mechanism to migrate prototypes, or portions of prototypes, to compiled code as the application matures. This is the best of both worlds; it allows for a quick start while still permitting an application to mature.

A final goal is necessary for all systems which combine scripting languages with compiled code. There must be some way to integrate seamlessly compiled modules into the scripting language as they are developed. All of these goals point toward making the system more flexible by giving users the ability to build their own systems by connecting and manipulating components. So while these are specific goals which led AIPS++ to adopt Glish as its scripting language, increasing flexibility is the reason AIPS++ and other projects have tended toward scripting languages.

At the ADASS meeting, three scripting languages were discussed: TCL/Tk, Python, and Glish. Most of the discussion was about Python, followed by TCL/Tk, and lastly Glish. Java was also discussed, but not received with as much enthusiasm as Python and TCL/Tk. A key criterion for adoption seemed to be an existing large user base. It seemed to make little difference whether or not the users were scientifically oriented. Certainly this bias is understandable. Once past the initial hurdles, it seems like both developers and users are happy with the script-based system. In some cases, it unifies libraries that lacked a uniform interface. In other cases, it just provides users with an interactive layer. In all cases, it seems that the new flexibility allows users to accomplish things that wouldn't be possible without the scripting language.

The next issue in this series on will discuss how these languages are extended and how they have been used.


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

Project News Summary
Tim Cornwell - NRAO, Socorro

Since the last newsletter, we made the first public release of AIPS++, a cause of great satisfaction (and relief!) to those inside the Project. The official release date was October 4, and the release was made at the 1999 ADASS in Kona, Hawaii. The release is source code and binary executables and is thus available only via CD-ROM. The systems supported are Linux and Solaris, and the bulk of the interest seems to be in Linux. We've also received a large number of requests from non-astronomical institutions, and from private individuals. The majority of the latter request either Linux or Windows NT (for which a port is not yet available). We have now exhausted the initial order of 1200 CD-ROMS (400 for each architecture supported), and are in the process of making new copies.

Now that the first release is out, our goal is to settle down to a six month release cycle, with patches to the existing release issued every month or so. The development plan for the next release (due April 2000) is available in AIPS++ Note 226, along with a description of the release process.

We have also embarked upon an outreach campaign timed to coincide with the release. At the AOC in Socorro, we held a series of 6 lectures entitled An Introduction to AIPS++. These were demonstrations of the use of AIPS++ in various contexts, drawing upon the document Getting Started in AIPS++, and the AIPS++ Cookbook. Attendance was good, 20-30 each day. Following that, Tim Cornwell and Athol Kemball made a tour of various European radio observatories to give talks and demonstrations. Overall, the reaction has been encouragingly positive. The first reaction is that AIPS++ is apparently powerful but also hard to learn. The tool-based approach is generally well-received, and the graphical user interfaces make a favorable first impression. The second reaction is that AIPS++ has many more uses than traditional reduction packages (something that we have deliberately designed, of course). The third major point that we learnt is that the pressure for a developer's release is higher than we had thought. With this last point in mind, we are considering the possibility of a developer's pre-release to be made in the next 6 months or so, targeted just for Linux platforms.

We plan to continue this outreach program with similar tutorials at other consortium sites, and other observatories, and with presentations at conferences such as the AAS in Atlanta in January 2000.


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

Bug Reports, Enhancement Requests, and Questions
Tim Cornwell - NRAO, Socorro

Now that AIPS++ is released, we expect to start receiving requests concerning the package. If the package is to grow and improve, active user participation is vital. For the moment, the best way to be involved is via bug reporting, submitting enhancement requests, and asking questions. Please don't be shy in sending these in. To submit any of these, type the following inside AIPS++:

bug() # for bug reports;
bug() # select the Enhancement button an enhancement request; and 
ask() # for questions

A web interface is also available at:

http://aips2.nrao.edu/docs/contactus/reportabug.html

We have a standardized way of dealing with requests using the Rational ClearDDTS package. When you submit a bug report, an enhancement request, or a question, a message is sent to ClearDDTS and a report, known as a defect, is initiated. Your message will be acknowledged via email and a defect number assigned. To determine the status of a given defect, you may use the web interface at


http://aips2.nrao.edu/docs/contactus/trackabug.html

Your initial submission then goes to a local center for disposition. The local center can be chosen using the aipsrc variable system.aipscenter and by putting one of the following in your .aipsrc file:

system.aipscenter: namerica           # For North America
system.aipscenter: europe             # For Europe
system.aipscenter: oz                 # For Australia

The default is namerica. For namerica, someone at NRAO/Socorro handles your request, for europe, someone at NFRA/Dwingeloo, and for oz, someone at ATNF/Epping. These people can provide immediate help for configuration problems. If a defect cannot be handled locally, it is forwarded to the aips2help queue, and assigned to an AIPS++ project member for processing. You can correspond with that person over the report. The easiest way to do this is just to reply to the messages sent from ClearDDTS. This ensures that a copy of all messages is maintained


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

AIPS++ Under Linux
Tim Cornwell - NRAO, Socorro

The Linux operating system on Intel-based PCs has become one of the most popular AIPS++ development platforms. The majority of the NRAO AIPS++ developers now use Linux, with a minority using either Solaris/Sparc or SGI/IRIX. For this reason one of the main platforms that we targeted for the first release was Linux: Red Hat 5.1, 5.2, and SuSE 6.0; and Red Hat 6.0, 6.1, and SuSE 6.2.

The CD-ROMs for these distributions are intended to contain all that is needed to run AIPS++. Thus, if you make a standard installation of Linux for these distributions, AIPS++ should easily install and be ready to run. The necessary shared libraries are included on the AIPS++ CD-ROM. One possible current exception is the lesstif library, as discussed later in this article.

In the future, we plan to closely track new releases of Linux distributions, and minimize the number of versions that we support. We are also considering a developer's pre-release that is targeted purely for Linux. Expressions of interest in this would be helpful in setting priorities.

Problems with running some Linux versions
Some users have reported that on their system the Red Hat 6.0 and SuSE 6.2 version of AIPS++ cannot be run either from the CD-ROM or from disk. The reason is that this version was linked against a shared lesstif library, libXm.so. Hence AIPS++ will not run from the CD-ROM or from disk unless you have installed Motif (a commerically available product) or lesstif (available under the GPL).

If you do not have Motif or lesstif installed, the easiest fix is to install the lesstif library from the following rpms lesstif-0.85-1.i386.rpm and lesstif-devel-0.85-1.i386.rpm.

These rpms are widely available. A copy is available from our server at aips2.nrao.edu. To install, type the following while logged in as root:

host> ftp aips2.nrao.edu
host> binary
host> cd pub/misc
host> get lesstif-0.85-1.i386.rpm 
host> quit
host> rpm -i lesstif-0.85-1.i386.rpm 

AIPS++ should then run correctly. You should not have to reinstall AIPS++ if you have already done so.


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

Use of AIPS++ Advanced Imaging Algorithms
Bob Hjellming - NRAO, Socorro

A special area of aperture synthesis imaging, that was explored in detail by Dan Briggs in his 1996 Ph.D. thesis, was the use of special algorithms to show the structure of ``moderately" resolved radio sources. One that was very useful for this purpose was the Non-Negative Least Squares algorithm. This algorithm has been implemented as one of the many available for aperture synthesis imaging in AIPS++. I have recently used these capabilities to make the best possible images from unique data for the 4th microquasar in our Galaxy, V4641 Sgr.

V4641 Sgr is an unusual X-ray transient that had extremely brief X-ray, optical, and radio outbursts September 15-16, 1999. When first observed with the VLA, only about twelve hours after the X-ray event that produced jet ejection, a 0.42 Jy source was obviously resolved in the North-South direction. Unfortunately, because the declination of this source is -25 degrees, the direction of elongation for the jets was only a few degrees from the normal elongation of the synthesized beam. Simple analysis of the amplitude distribution showed that the main structure should have a size scale of 0.25" at a position angle of 162 degrees. Normal imaging and deconvolution with the CLEAN algorithm produced a symmetric triple structure, with +/- 0.25" components at exactly the beam-related separation where CLEAN can introduce spurious structure. In addition, seven radio telescopes made multi-frequency radio observations during the first 24 hours of the radio event, and the VLA was able to follow it down to a level just above the noise at 120 mJy three weeks later; the fitting of models to the light curve data indicated that this was a highly relativistic, ~0.9c, superluminal (1.5c) jet source, so one would have expected the radio emission to be dominated by one side.

For normal radio sources, more data clarifies the situation. However, the radio event in V4641 was so fast that when the next imaging run was made with the VLA 1.9 days later, there was only a weak remnant of about 11 mJy. Most of the 0.42 Jy structure seen in the images for the two eight minute scans at 4.9 GHz on September 16 was gone.

Over the Christmas 1999 holiday week and the first week of 2000 we used AIPS++ NNLS imaging on the irreplaceable September 16 event data. The first results were very promising, and by the time I went to the Atlanta AAS meeting to present the paper on this object, we had images that matched everything we knew about the event. The initial structure was dominated by one-sided structure, 0.25" in size - and we could see changes in the central regions of the jet in the images made from data only 30 minutes apart.

The images of V4641 Sgr shown above are 1" in size. The two 4.9 GHz images at the left were made with the AIPS++ NNLS function in the imager tool using VLA data taken September 16.027 and 16.048 UT. In the 30 minutes between those two images the total flux dropped from 0.42 to 0.40 Jy and the peak structure spread along the direction of motion of the jet. The third image at the right shows the result of an image made with CLEAN in the imager tool, using September 17.94 UT data at 14.9 GHz - for which there was fast position switching between V4641 Sgr and a calibrator 22' away. This radio image shows the location of the weak decaying radio source that was observed at this position until it was not detectable after 1999 October 7. This image sequence shows that the September 16 radio emission was one-sided jet ejection at a position angle of 162 degrees.

Without any complicated analysis, these images show that the initial jet ejection was highly relativistic and one-sided with a size scale of 0.25" attained about 12 hours after the associated X-ray events. This is because, while V4641 Sgr is a superluminal jet source like GRS 1915+105, GRO J1655-40, and XTE J1748-288, unlike these sources which are 12, 3, and 8 kpc away, V4641 Sgr is very close - only 0.5 kpc away.

It is very gratifying to be able to go beyond the testing of capabilities that have been available in other data processing systems to using some of the more advanced algorithms which are easily developed in AIPS++.


Table of
Contents:

AIPS++
and
the Green
Bank
Telescope

Glish as a
Scripting
Language

Project
News
Summary

Bug
Reports,
Enhance-
ment
Requests,
and
Questions

AIPS++
Under
Linux

Use of
AIPS++
Advanced Imaging Algorithms

What's
New

What's New: June - December 1999
Athol Kemball - NRAO, Socorro

A primary focus has been identifying and correcting defects in preparation for the public release of AIPS++. The stability of the system was been improved during this process. An additional effort has been undertaken to standardize the appearance of GUI's so that they meet the newly established project GUI guidelines.

The project web pages and documentation have continued to be improved in layout, content and through the addition of new pages and references. The ClearDDTS defect-tracking system has been fully integrated into the web documentation. A first edition of a cookbook for scientific users has been produced, covering a range of data reduction capabilities in the package.

The Display Library and the Viewer application have received extensive enhancements in several areas, including display event handling (eg. motion or position), coordinate support, panning and zooming, RGB/HSV development and extension of the capabilities of the Postscript canvas.

In imaging and deconvolution applications, new algorithms are now supported including MEM in imager, multi-scale multi-field deconvolution, and wide-field or multi-field Hogbom CLEAN. Improvements have been made in the computational efficiency of several algorithms, and in deconvolution progress displays. New test functions have been added to verify that correctness of the algorithms. The simpleimage application has been upgraded and now can be launched from the tool manager. The wide-field facet calculation algorithm has been improved. An initial version of single-dish data gridding has been added, along with preliminary support for holography and "on-the-fly" (OTF) data types.

The tool manager has received a large number of refinements and upgrades to improve window handling, expand the capabilities and to support new GUI data entry widgets. The library of standard GUI widgets has been improved and extended.

A number of changes have been made to the Image tool. The constructors shapetoimage() and arraytoimage() will now make an appropriate coordinate system if at all possible, rather than just a simple linear in each dimension. Computation of flux statistics has been added, as well as new capabilities in image concatenation, functions to Fourier transform an image, progress displays in areas such as histogram computation, and initial support for image polarimetry. The image component fitter now allows both a model and aclip range, and can include or exclude the pixel ranges to be used in fitting. The function fit2d() has been renamed to fitsky().

The Parkes multi-beam software has been revised and improved in a number of areas.

In single-dish development, significant effort has gone into expanding the GBT data fillers to support a wide variety of back-end data formats and data-associated parameter (DAP) files. The commissioning tools for the GBT have been extended, as there have been numerous improvements to the Dish GUI and its functions.

The VLA filler has undergone extensive development during this period, including new support for auto-correlation data, IF status flags, reading from tape or disk, and the correction of scaling errors. Data loading from remote tapes is now supported. A number of new features have also been added to the RPFITS filler.

The measures software now has new FITS conversion utilities, and also has undergone general improvements. Glish now supports an option to be built with the Boehm-Demers-Wesier automatic garbage collection system.

The UVFITS capabilities for reading and writing have been improved for multi-source data files, GC and TY sub-tables, and in support for a broader range of FITS parameters.

The visibility plotter visplot has had improvements in the area of data selection, robustness, and speed.

Support for calculating the standard flux densities provided by the Perley-Taylor coefficients has been added to imager as the function setjy(). The calibrater tool has a new function to plot calibration solutions (plotcal), and also to establish overall flux density scales (fluxscale). Calibration selection using FIELD_ID is also now available.

Component model support has been improved through the identification and correction of some defects, and the addition of new capabilities.

The NFRA software supporting the commissioning of the Telescope Management System (TMS) has been further developed in a number of areas.

The simulator has been revised to work from an MS, and it now allows the addition of a broader range of physically meaningful calibration errors.

In the system area, a new utility, checker, has been added to verify that the AIPS++ environment is suitable for running specified packages. The memory allocation infrastructure has been updated, a new combined server has been added to reduce memory use, and the parallelization code has been updated to track other changes in the library.

An initial version of an editing tool, flagger, has been added to the system.

The catalog tool has been improved in several areas, including showing a busy cursor when making lists, recognizing graphics formats correctly, and handling of the image viewer.

The table system has been improved in several areas. A new function, addColumns(), has been added and the support for measures in tables has been extended.


New Mail Exploder for AIPS++
Tim Cornwell - NRAO, Socorro

There is a new moderated mail exploder aips2-user@nrao.edu now up and running. This is designed for disseminating information about AIPS++ to our users. To subscribe to this list, send mail to aips2-user-request@majordomo.cv.nrao.edu with the word "subscribe" in the body of the message. To unsubscribe, send a message with the word "unsubscribe".


Kate Weatherall
Last modified: Thu Mar 16 08:36:33 MST 2000