Some locals say rent hikes prompted by an influx of construction workers are pricing them out.